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Assistant Commissioner for Patents 
Washington, D.C. 20231 

PRELIMINARY AMENDMENT 

Prior to its examination, please amend the above-identified continuing 
application as follows: 



IN THE SPECIFICATION 



Please amend the specification, as follows: 

Replace the title with: -MEDICAL IMAGING INSTRUMENTS, SYSTEMS AND 

METHODS-. 

Page 1 , before the first line, insert the paragraph: -This application is a continuation- 
in-part of pending application number 09/228,773, filed January 11,1 999, which is a division of 
application number 08/791,637, filed January 31, 1997, now abandoned.- 
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Page 1 , lines 2-1 1 , replace entire paragraph with the following: --This invention 
relates to medical instruments, systems and methods and, more particularly, to medical instruments, 
systems and methods for use in imaging a site in a medical procedure.- 

Page 3, line 8, replace "and displayed on a video monitor or" with -to generate a video 
output signal used to produce an output image displayed by a video monitor, printed by a printing 

device, and/or-. 

Page 5, line 8, replace "operating" with -operative-. 

Page 5, line 12, replace "compensator" with -processor-. 

Page 5, line 18, before "For example", insert the following: ~ Differential picture 
brightness tends to take different forms.- 

Page 5, line 25, after the sentence, insert the following: "As yet another example, 
differential picture brightness may arise due to deficient alignment of the illumination with the 
site/area being imaged. In this latter form, differential picture brightness is typically characterized by 
a bright portion toward one side of the picture, decreasing brightness with disposition toward the 
picture's other side and a dark or black crescent or other portion of the picture adjacent that other 
side's periphery. In any form, differential picture brightness is characterized by spatial differences 
(particularly, observable differences) in brightness, e.g., from one picture edge, through the picture 
center, to an opposite picture edge or otherwise across or among spatial components of the 
picture.- 

Page 6, line 5, after "brightness", insert -(e.g., by reducing spatial differences)-. 
Page 7, line 20, replace "discloses" with -purports to disclose-. 
Page 8, line 9, replace "discloses" with -purports to disclose-. 
Page 8, lines 12-15, delete the sentence "The correction system is capable ...to a 
digitized video signal." 
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Page 8, lines16-20, replace "for identifying the required correction within a video 
frame, a calculating portion for computing the amount of correction to be applied to the video signal, 
and a correction portion for correcting the video signal based upon the correction computed by the 
calculating portion" with -for inspecting the amplitude of the output of the pixels which are part of 
the video image when the image is that of a flat white calibration target, a calculator portion for 
calculating for each pixel inspected a white shading correction coefficient, and a correction portion 
for correcting pixels in subsequent video images based on the white shading correction coefficients 
calculated by the calculator portion-. 

Page 8, line 21, replace "discloses" with -purports to disclose-. 

Page 9, line 3, replace "date" with -data-. 

Page 9, line 7, replace "Patents 4,979,598 and 4,979,042" with -Patent 4,979,042 

purports 

Page 10, lines 1-4, replace "The above described prior art represent the typical 
electronic correction devices and methods to correct shading in an optical image for a variety of 
video imaging apparatus and system." with -The above-identified references indicate approaches 
directed to correction of shading associated with inherent deficiencies in either/both the imaging 
performance of video cameras/sensors and such cameras" optics. As previously described, other 
known approaches are directed to optimizing light sources and guides. Notwithstanding these 
approaches, alone or together, differential picture brightness remains a problem in acquired images 
of interior spaces due to illumination deficiencies.- 

Page 10, after line 4 and before line 5, insert the following paragraphs: 
-Differential picture brightness due to illumination deficiencies remains a particularly 
significant problem in the medical field wherein a patient's health typically is at stake. As an 
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example, the success or failure of laparoscopic surgery may depend in substantial part on the 
quality at which the operative site is imaged for the surgery team. 

Accordingly, there is a need for medical imaging instruments, apparatus and methods 
that address illumination deficiencies, particularly uneven illumination of the operative site/inspection 
area- 

Page 10, line 18, change "compensating signal used " to -compensated video signal, 
or for using the compensating signal to -. 

Page 10, line 12, change "compensating video signal used" to -compensated video 
signal, or for using the compensating signal to -. 

Page 10, line 13, delete "video". 

Page 14, line 21 , change "located as or" to -or a light source-. 
Page 15, line 5, replace "optical" with -medical-. 
Page 15, line 6, replace "imager with -image-. 
Page 19, line 21, replace "the" with -a~. 

Page 20, line 1, replace "processing" with -processor, and an-, and replace "with the" 

by ~, including a- 

Page 20, line 6, replace "a monitor" with -an output device, and ~. 

Page 20, line 11, replace "a monitor" with -an output device, and -. 

Page 20, line 12, replace "processor" with -compensator-. 

Page 20, lines 14-23, replace "Fig. 12(a) and 12(b) represent... respectively;" with 
-Figs. 12(a) and 12(b) show, respectively: (i) a video signal representing an optical image having 
differential picture brightness and (ii) a compensated video signal representing an optical image 
having substantially uniform brightness.- 
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Page 20, line 24, replace "Fig. 13(a) and 13(b)" with --"Figs. 13(a) and 13(b)- and, 
after "of*, insert --respectively--. 

Page 21, line 2, replace "of with -(ii)-. 
Page 21, line 3, delete ";" and "(ii)". 
Page 21, line 4, delete ", respectively". 

Page 21, line 8, replace "are waveforms" with -show, respectively, a waveform--. 

Page 21 , line 12, delete ", respectively". 

Page 21 , line 18, change "the differential" to -differential--. 

Page 21, lines 19-23, delete "cross-sectional... from the digital signal processor". 

Page 21 , line 25, replace all with -a-. 

Page 22, lines 2-3, replace "having the ...processor having" with -and-. 
Page 22, line 9, replace "the" with -a-. 

Page 22, line 14, replace "which" with -of Fig. 19 which sensing device-. 

Page 22, line 15, after the paragraph, insert the following paragraph: - Fig. 22 is a 
high level block diagram of a medical imaging instrument or system, in accordance with the 
invention.- 

Page 22, line 16, replace "DESCRIPTION OF THE PREFERRED EMBODIMENT" with 
-DETAILED DESCRIPTION-. 

Page 22, line 23, after "camera.", insert the following sentence: -As an example, the 
following review will provide background to advance understanding of the application and utility of 
the present invention in medical imaging instruments, apparatus and methods. The background is 
directed particularly to video applications, wherein the invention is directed to enhance real-time 
motion signals (e.g., frame by frame). - 

Page 23, line 7, replace "CCD" with -video sensor (e.g., a CCD)-. 
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Page 23, line 1 1 , after "as", insert --an--. 
Page 23, line 14, replace "Format" with -format--. 
Page 23, line 19, replace "a" with ~an~. 
Page 23, line 24, replace "Format" with -format--. 

Page 23, line 24, through page 24, line 6, create a new paragraph beginning with "It is 
also envisioned...". 

Page 24, line 4, after "of, insert -either-. 

Page 24, line 5, replace "The Format" with -format, or the term "format" alone in 
appropriate context-. 

Page 24, line 7, after "sensor", insert a comma. 
Page 24, line 14, replace "Format" with -format-. 

Page 24, lines 15-17, replace "The video signal compensator... video camera." with - 
Each of the above-described video cameras, as well as other video cameras, are expressly 
contemplated within the scope of the invention. Moreover, the video sensors of such cameras may 
be variously implemented without departing from the principles of the invention.- 

Page 24, line 18, replace "a video sensor" with -any video sensor-. 

Page 24, lines 19-21, replace "line sensor... invention including" with -including solid 
state sensors and tube-based sensors, including, as non-exhaustive examples, line sensors, area 
sensors, CCDs, CMOS sensors and other photodiode/photoconductor arrays, as well as vidicon and 
orthicon tubes and combinations of same. The term "video sensor" includes- 

Page 24, line 24, replace "at a CCD" with -(a)-. 

Page 24, line 25, after "located", insert -at- and replace "or to a video", with -or (b) a 
sensor of a video-. 
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Page 25, line 1 , after "camera", insert -, tlie camera being- and replace "an optical 
instrument, endoscope" with -a medical instrument (e.g., an endoscope)-. 

Page 25, line 3, replace "optical Instrument" with -medical instrument-. 

Page 25, lines 4-5, replace "a CCD sensor or video camera" with -the video sensor-. 

Page 25, lines 10-11, replace "a rigid, elongated sheath tube 32" with -a housing 32 
(e.g., a rigid sheath tube)- 

Page 25, line 14, replace "means," with -structure. The optical image transferring 
structure may be variously Implemented, Including as a-. 

Page 25, line 15, replace "typically" with -but typically comprises- and replace 
"lenses," with -lenses. In any case, the optical image transfemng structure provides-. 

Page 25, line 16, replace "through" with -(through-. 

Page 25, line 17, replace "ridged elongated sheath tube 32" with -housing 32)-. 

Page 25, line 18, at the end of the paragraph, insert the following: -Although the 
elongate housing 32 Is generally referred to herein as being rigid. It is understood that the housing 
and, in turn, the instrument 30 may be other than rigid (e.g., flexible or semi-flexible), without 
departing from the principles of the invention.- 

Page 25, line 21, replace "means for supporting" with -structure to support-. 

Page 25, line 22, replace "means for defining" with -structure to define-. 

Page 25, line 24, replace "Valve means" with -Valves-. 

Page 26, lines 7-8, replace "processing means, for example 134 in Fig. (8), " with 
-processor (such as processor 134 of Fig. 8)-. 

Page 26, line 10, replace "means" with -device, or for printing the image, or for other 

purposes-. 

Page 26, line 22, delete "shown as". 
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Page 26, line 25, replace "rigid elongated sheath tube 32" with -housing 32-. 
Page 27, line 3, at the end of the paragraph, insert the following: 
-(Hereinafter, the operative site and inspection area are sometimes referred to, alone or together, 

as the "target site".)- 

Page 27, line 12, as the end of the paragraph, insert: -The light energy typically is 
white, visible light; however, it is to be recognized that the light energy may include frequency 
components outside the visible light spectrum, either supplemental to or in substitution for some or 
all of the white light frequencies. Examples include infrared and x-ray radiation. - 

Page 28, line 2, replace "and" with ~and/or-. 

Page 28, line 8, replace the comma with a period. 

Page 28, line 10, delete "is". 

Page 28, line 11-12, replace "and illuminates" with -to illuminate-. 

Page 28, line 17, replace "means" with -structure-. 

Page 28, line 18, replace "rigid elongated sheath tube 32" with -housing 32~. 

Page 28, line 19, replace "means" with -mechanism-. 

Page 28, line 20, replace "means" with -device-. 

Page 28, lines 20-21, delete "shown generally as". 

Page 28, line 21 , replace "means" with -device-. 

Page 28, line 22, replace "of member" with -or member-. 

Page 28, line 23, replace "means" with -device-. 

Page 28, line 24, replace "may be" with -comprises one or more of -. 

Page 28, line 24, replace "for a CCD" with -for or of a CCD-. 

Page 28, line 25, replace ", or video sensor" with -(or other video sensor), fiber 

optics, -. 
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Page 28, line 25, replace "means" with -mechanism-. 

Page 29, lines 1-2, replace "is shown generally as" with -comprises a--. 

Page 29, line 3-4, delete "shown as" and "which houses... through 7". 

Page 29, line 4, insert at the paragraph's end, the sentences: -In Figure 3, the 
mechanism that directs fluid flow across the exterior surface of the image passing device also 
comprises a second nozzle 82, such nozzle being located in the space 70 at a selected distance 
from nozzle 80. Such mechanism may comprise any selected number of nozzles 80, 82 and/or 
other selected structure.- 

Page 29, line 4, after "nozzle", insert -80- and, after "channel", insert -86--. 

Page 29, line 7, replace "transparent member" with -image passing device-. 

Page 29, line 9, delete the comma. 

Page 29, line 10, replace "transparent member" with -image passing device- and 
replace "second" with -inrigation™. 

Page 29, line 13, replace "transparent member" with -image passing device-. 

Page 29, line 16, at the paragraph's outset, insert the following sentence: -The fiber 
optic light guide 72 typically comprises one or more light fibers, bundled or otherwise.- 

Page 29, line 16, after "are", insert -arranged in plural bundles, the bundles being 
disposed in space 70. Typically, as shown, the bundles of light fibers are-. 

Page 29, line 21 , replace "the illustrated" with -that illustrated-. 

Page 29, line 22, replace "uses" with -purposes™. 

Page 29, line 25, replace "the illustrated" with -that illustrated-. 

Page 30, line 2, replace "space" with -spaced-. 

Page 30, line 3, delete "optical image transferring". 
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Page 30, line 10, replace "transparent member" with -image passing device-, and 

replace "of with -off-. 

Page 30, line 13, replace "transparent member with -image passing device-. 
Page 30, line 14, replace "axis" with -axes-. 

Page 30, lines 15-16, replace "rigid elongated sheath tube 32" with -housing 32-. 
Page 30, line 25, replace "non-unifomn" with -non-uniformity of-. 
Page 31, line 2, replace "the compensating" with 
-as is described further hereinafter, a ~. 

Page 31, line 3, delete "apparatus or". 
Page 31, line 5, after "7", insert -so as-. 

Page 31 , lines 6-7, replace "due to" with ~, notwithstanding the light guide's directing 

of non-uniform or -. 

Page 31 , line 10, replace "the light bulb or" with ~a light bulb or other-. 

Page 31 , line 11, replace "The light bulb or" with -As an example, the light bulb or 

other-. 

Page 31 , line 12, as the end of the paragraph, insert the following: -(The light bulb, 
light source, light guide and other structure associated with illuminating a target site are sometimes 
referred to herein, individually, collectively and grouped, as an "illuminator".)- 

Page 31, lines 13-14, replace "compensating apparatus" with -an analog video 

camera-. 

Page 31 , line 16, replace "use" with -used-. 
Page 31, lines 17-19, delete "developed from... source". 
Page 31 , line 21 , replace "directly" with -directly or indirectly-. 
Page 32, line 2, replace "124" with -126~. 
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Page 32, lines 6-7, replace "or compensating apparatus 130" with --130 (the video 
signal compensator is sometimes referred to herein as a "compensating apparatus")-. 
Page 32, line 8, delete "or compensating apparatus". 
Page 32, line 12, change "compensating" to -output-. 

Page 32, line 13, delete "or compensating apparatus" and replace "shown as" with -as 

provided on-. 

Page 32, line 16, replace "video" with -signal-. 

Page 32, line 17, replace "Format" with -format-. 

Page 32, lines 18-19, replace "When ...134, the" with -The-. 

Page 32, lines 18-19, replace "When the compensating signal. ..134, the" with -The-. 

Page 32, line 20, between "a" and "video", insert -formatted-. 

Page 32, line 22, delete "output". 

Page 32, lines 23-24, replace "a monitor, video storage device, printer or other video" 
with -an output- and, "after box 138", insert -(Hereinafter, the term "output device" contemplates, 
without limitation, display devices (e.g., flat panel display technology, light valve technology, tube 
technology or otherwise), printing devices, storage devices (e.g., CD, DVD or other optical or 
magneto-optical storage, VCR, RAID, hard drive, or other analog/digital, temporary/semi- 
pemianent/penmanent storage), networking devices and other similar devices.)- 

Page 33, line 5, replace "CCD" with -video-. 

Page 33, line 8, after "signal", insert -so as-. 

Page 33, line 9, replace "processor" with -processing apparatus 128-. 

Page 33, line 10, replace "preamplifier" with -amplified-. 

Page 33, line 1 1 , before "compensating", insert -the- and, after "added", insert -, 
multiplied, mixed, interpolated, extrapolated or othenwise applied together before or at-. 
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Page 33, line 12, replace "process a" with --outputs a formatted,--. 
Page 33, line 13, at the end of the paragraph, insert the following as a new paragraph: 
-As is readily apparent to anyone of skill in the art, the compensating 
signal may be variously applied to the video signal. As an example, the compensating signal may 
be applied within the video signal processor 134. To do so, the video signal processor 134 has 
applied, as inputs, the compensating signal and the amplified video signal, each via output 132. 
The so-input amplified video signal, in such case, is passed through the video signal compensator 
130. In such case, the video signal processor 134 may apply the compensating signal so as to 
control the processing (e.g., the gain) of the video signal, or it may add, multiply, mix, interpolate, 
extrapolate or othenwise process the compensating signal with the video signal. As another 
example, the video signal compensator 130 generates the compensating signal and applies that 
compensating signal with the video signal, so as to output to the video signal processor 134 a 
compensated video signal for formatting. The application is implemented by adding, multiplying, 
mixing, interpolating, extrapolating or otherwise applying together the compensating signal and the 
video signal. 

The compensator 130 may be variously implemented in generating the 
compensating signal. As an example, the compensator 130 can be implemented to generate the 
compensating signal from components of the video signal. These components typically include one 
or more, or combinations of: timing components, synchronization components, and test, marker or 
other references embedded in the video signal (e.g., in the content portion thereof). Use of 
embedded references engenders advantages, including enabling the system to recognize and track 
changes in the orientation of the endoscope. Such changes, which typically arise from 
manipulations related to the applicable medical procedures and which include rotation about the 
endoscope's elongate axis, tend to result in variations in illumination, including changes in 
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differential picture brightness. If the differential picture brightness characteristics are the sanne, but 
merely rotated or otherwise re-oriented, the tracking enable the connpensation to be adapted 
thereto." 

Page 33, line 14, after "add", insert --multiply, mix, interpolate, extrapolate, or 
otherwise apply together the amplified video signal and-. 

Page 33, line 15, delete "to the video signal" and, before the period, insert -to a pre- 
selected format™. 

Page 33, line 18, replace "directly" with -directly or indirectly-. 

Page 33, line 22, replace "output" with -conductors-. 

Page 34, line 3, replace "analog" with "digital". 

Page 34, line 8, replace "Format" with -format-. 

Page 34, line 10, delete "then". 

Page 34, lines 11-12, replace "added to and compensates... to represent" with -added, 
multiplied, mixed, interpolated, extrapolated or otherwise applied with the video signal output by the 
digital-to-analog converter 150, so as to produce a formatted, compensated video signal 
representing-. 

Page 34, line 13, replace "illumination." with -brightness. As an example, the video 
signal compensator 154 generates the compensating signal and applies that compensating signal 
with the video signal. The application is implemented by adding, multiplying, mixing, interpolating, 
extrapolating or otherwise processing together the compensating signal and the video signal.- 

Page 34, line 13, replace "output" with -video-. 

Page 34, line 15, replace "video" with -output-. 

Page 34, line 16, replace "waveform" with -signal--. 

Page 34, line 16-17, replace "added ...processor." with -otherwise introduced.- 
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Page 34, line 19, replace "added to the video signal" witli -produced-. 
Page 34, line 23, replace "directly" with -directly or indirectly-. 
Page 35, line 4, replace "an analog-to-digital converter" with -video signal 
compensator-. 

Page 35, line 5, replace "a compensated analog" with -an analog compensated-. 
Page 35, lines 6-7, replace "differential ... illumination." with -substantially uniform 

brightness.- 

Page 35, lines 8-9, replace "wherein the digital signal is" with -wherein the output is a 

digital signal that is-. 

Page 35, line 10, after "digitized", insert ~, fonnatted-. 

Page 35, line 12, replace "163 wherein the output signal from" with -163. The output 

of-. 

Page 35, line 13, replace "processed" with -formatted-. 

Page 35, lines 14-15, replace "differential ... illumination" with -substantially uniform 

brightness-. 

Page 35, line 17, replace "video" with -output-. 

Page 35, line 19, before the paragraph, insert the following paragraph: -As described, 
the digital signal processor 162 has applied, as an input, the compensated video signal output from 
the video signal compensator 160. To do so, the compensator 160 adds, multiplies, mixes, 
interpolates, extrapolates or otherwise applies the compensating signal with the amplified video 
signal. In the alternative, the compensator 160 generates the compensating signal and passes 
through the amplified video signal, both as inputs to the analog-to-digital converter 161. In the latter 
case, either the analog-to-digital converter 161 or the digital signal processor 162 applies the 
respective signals to produce the compensated video signal. - 
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Page 35, line 23, replace "directly" with -directly or indirectly-. 
Page 36, lines 4-6, replace "where the output... uneven illumination" with -so as to 
output a formatted, compensated video signal representing the optical image having substantially 

uniform brightness-. 

Page 36, line 8, replace "Format" with -format-. 

Page 36, lines 10-11, change "in the preselected fonnat" to -(e.g., in or responsive to 

the preselected fonnat)-. 

Page 36, lines 11-13, replace "added to and compensates... uniform illumination" with 
-added, multiplied, mixed, interpolated, extrapolated or othenwise applied with the formatted video 
signal, so as to produce the formatted, compensated video signal-. 

Page 36, line 15, replace "video" with -output-. 

Page 36, line 16, create a new paragraph starting with "It is envisioned...". 
Page 36, line 17, replace "used" with -implemented-. 

Page 36, line 18, replace "even in ...processor" with -integral with the video signal 
processor (whether analog or digital)-. 

Page 36, line 19, replace "the" with -a-. 

Page 36, line 20, replace "162" with -171- and replace "the" with -a-. 
Page 36, line 21, replace 'The" with -A-. 

Page 36, line 22, replace "for brightness is shown as 170" with -170 is depicted which 
represents an optical image having substantially uniform brightness-. 
Page 36, line 23, replace "162" with -171~. 

Page 36, line 24, replace "a reference 170" with -the optical image represented by the 

reference line 170,-. 

Page 37, line 1 , after "image", insert -1 1 8~. 
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Page 37, line 2, after "than", insert -the optical image represented by- and, after 

"reference", insert -line-. 

Page 37, lines 4-18, replace "the optical image... substantially unifonn brightness." with 
the following: -the optical image of Fig. 12(a) having substantially uniform brightness. The 
compensated video signal of wavefonn 178 is generated by conditioning the waveform 171. In this 
illustration, the wavefomi 178 is generated by conditioning the waveform 171 with one or more 
compensating signals so that (a) the amplitudes of the portion 174 of waveform 171 which are 
brighter than desired are appropriately decreased to form portion 180 of wavefonn 178, (b) the 
amplitudes of the portions 172 of waveform 171 which are less bright than desired are appropriately 
increased to fonn portions 180 of waveform 178 and (c) the amplitudes of the portions 172 of 
waveform 171 which correspond to sites which are expected to be non-illuminated or non-imaged 
are appropriately decreased to fonn portions 181 of waveform 178. As such, the waveform 178 
corresponds substantially closely at relevant times to the level of the reference line 170, such 
correspondence reflecting an optical image having substantially uniform illumination. 

It is to be recognized that, while Figs. 12(a) and (b) respectively depict a 
small portion of a video signal and its compensated video signal (e.g., one line of video content for a 
video frame), the deficiencies and compensation therefor as illustrated therein are applicable to 
these signals for the optical image entirely or in any selected part, whether described vertically, 
horizontally and/or radially, or othenwise. That is, the compensation or other conditioning preferably 
is directed to ameliorate or correct differential picture brightness spatially.- 

Page 37, line 19, replace "represent" with -represents- and replace "wherein" with - 

having-. 

Page 37, line 20, delete "the", insert a period after "brightness" and replace "of an" 

with -The-. 
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Page 37, line 22, replace "portion" with -portions--. 
Page 37, line 23, replace "line" with -lines-. 

Page 37, lines 23-25, replace "depict the. ..less bright" with -depict acceleration in the 
decrease of brightness toward the optical image's periphery 190-. 

Page 37, line 25, at the end of the paragraph, insert the following sentence: -The 
shaded portion about the optical image's center 188 indicate brightness (uniform or otherwise) that 
exceeds a desirable level.- 

Page 38, line 1 , replace "represent" with -represents- and replace "wherein" with - 

having-. 

Page 38, line 2, delete "the", insert a period after "brightness" and replace "of an" with 

-The-. 

Page 38, line 4, replace "portion" with -portions-. 
Page 38, line 5, replace "line" with -lines-. 

Page 38, lines 5-7, replace "depict the... at the center 198" with -depict acceleration in 
the decrease of brightness toward the optical image's center 198-. 

Page 38, line 7, at the end of the paragraph, insert the following new paragraph: -It is 
to be understood that, although Figs. 13(a) and 13(b) depict radially symmetric brightness functions 
(e.g., brightness levels vary but the variations are consistent among radii, with such variations being 
functions of disposition along a radius and not the radius' angle), such symmetry may be absent in 
practice. That is, brightness may be anywhere from less symmetric to partly or wholly asymmetric, 
including by varying either/both by radial disposition and angle. In addition, brightness may be 
characterized by variations in either/both horizontal and vertical dimensions associated with the 
optical image.- 

Page 38, line 18, before "which", insert -(-, and replace "of the" with -an-. 
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Page 38, line 19, after "8", insert -)-. 

Page 38, line 20, replace "the form of the basic" with -compensating waveforms" and 
replace "are used in" with -associated with-. 

Page 38, line 21 , after "compensator", insert a period and replace the remainder of the 
line with -Although only sawtooth and parabolic waveforms are discussed in the following 
descriptions, it is recognized that either or both of these waveforms may be omitted, and that any 
number and variety of other waveforms may be employed (alone or in combinations with the 
sawtooth and/or parabolic waveforms), without departing from the principles of the invention. As an 
example, such other and combinations of waveforms may be employed when the differential picture 
brightness is characterized by partly or wholly asymmetry. As another example, the waveforms may 
be preset, so as, e.g., to correlate to and correct known deficiencies associated with medical 
imaging instruments and systems. As to this latter example, the preset waveforms preferably are 
brought into operation either manually or automatically, (e.g., by detection of the imaging instrument 
or one or more components of a system- 
Page 38, line 22, delete all. 
Page 38, line 25, replace "the" with -addressing-. 
Page 39, line 1, replace "to produce" with -toward producing-. 
Page 39, line 2, delete "a". 

Page 39, line 9, at the end of the paragraph, insert: -The sawtooth wave generators 
described, as well as selected additional sawtooth wave generators, may be integral, grouped or 
separate, without departing from the principles of the invention,- 

Page 39, line 16, at the end of the paragraph, insert: -Plural parabolic wave 
generators may be provided, whether integral, grouped or separate, without departing from the 
principles of the invention.- 
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Page 39, line 21 , replace "the sawtooth" with -each sawtooth-. 
Page 39, line 22, replace "the parabolic" with -each parabolic- 
Page 39, line 23, delete "as required". 

Page 39, line 24, after "In operation,", insert -a typical implementation of a video signal 
compensator provides-. 

Page 40, line 19, delete "as required". 
Page 40, line 21 , replace "136" with -236--. 
Page 40, line 22, replace "136" with -236-. 
Page 41 , line 5, delete the comma. 
Page 41 , line 6, replace "a" with -the--. 
Page 41, line 10, delete the comma. 

Page 41, lines 12-13, delete "having a controlled amplitude and orientation". 
Page 41, line 15, replace "136" with -236,-. 

Page 41 , line 21 , replace "waveform generator" with -wave generator-. 

Page 42, line 3, replace "is" with -are-. 

Page 42, line 6, replace "Amplifier" with -amplifier-. 

Page 42, line 7, replace "issued" with -is used-. 

Page 42, line 12, replace "302" with -286-. 

Page 42, lines 13-14, replace "depicted as balance network 286 and the" with -, 

which-. 

Page 42, line 16, delete "input". 

Page 42, line 20, after "having", insert -a predetermined falling slope and controlled 
amplitude in the fonm of sawtooth waveform 21 2-. 

Page 42, line 23, replace "a" with -the-. 
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Page 43, line 1, delete the comma. 
Page 43, line 4, delete both quotation marks. 

Page 43, line 5, replace "302 of with -302, which is- and, after "286", insert a 

comma. 

Page 43, line 7, replace "waveform" with --waveforms-. 
Page 43, line 1 1 , replace "wavefonn generator" with -wave generator--. 
Page 43, line 19, replace "to represent the" with -toward such video signal 
representing an-. 

Page 43, line 23, replace "the desire" with ~a selected-. 

Page 44, line 7, replace "An adder" with -Typically, an adder or other component-. 

Page 44, line 8, replace "add" with -add, multiply, mix, interpolate, extrapolate or 
otherwise apply together- 
Page 44, lines 13-15, replace "required for the differential ...compensating signal" with 
-facilitating production of a compensated video signal (i.e., a video signal representing an optical 
image having substantially uniform brightness) from a video signal representing an optical image 
having differential picture brightness.- 

Page 44, lines 15-16, delete "the parabolic waveform would be used alone". 

Page 44, lines 19-20, replace "at least... brightness. In the" with -an optical image 
having decreased differential picture brightness (i.e., increased uniformity in brightness). In a-. 

Page 44, line 22, before "produce", insert -to- and, after "signal", delete "used". 

Page 44, lines 23-24, delete all. 

Page 45, line 1, replace "is added to" with -typically is added, multiplied, mixed, 
interpolated, extrapolated or otherwise applied with-. 

Page 45, line 2, delete "at the input of a video signal processor 1 34". 
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Page 45, line 3, replace "compensating" with --compensated- and replace "process" 
with -processing apparatus 128 preferably--. 

Page 45, line 4, replace "the gain" with -gain--. 

Page 45, line 5, after "horizontal!/, insert -, e.g., - and replace "gain of with -gain 
applicable to-. 

Page 45, line 7, replace "reference and" with -reference level and/or, e.g., by-. 

Page 45, line 9, replace "a reference" with -the same or another reference level and, 
thereby,- and, after "an", insert -optical-. 

Page 45, line 10, at the end of the paragraph, add the following new paragraph: 
-It is understood that the compensated video signal may be subject to processing in addition to 
formatting. As an example, the compensated video signal may be processed to remove artifacts. It 
also may be processed so as to respond to signal saturation, as might occur when, during a medical 
procedure, a reflective medical instrument enters a portion of the target site characterized by an 
enhanced gain via a compensating signal. In that event, the enhanced gain typically would be 
reduced and, preferably, that reduction would be implemented on a dynamic basis.- 

Page 45, lines 11-12, replace "In the ...brightness" with -In a typical case, an optical 

image-. 

Page 45, line 13, replace "adder adds the sawtooth waveform," with implemented 
according to Figure 16, adds, multiplies, mixes, interpolates, extrapolates or otherwise applies 
together one or more sawtooth waveforms and-. 

Page 45, line 14, replace "and the video signal" with -(and, in some embodiments, the 
video signal or portion(s) thereof), such waveforms being properly balanced and otherwise 
calibrated,-. 
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Page 45, line 15, after the first "signal" and after "processor", insert respective 
periods, and replace "which" with -The compensating signal typically is employed within the video 
signal compensator or--. 

Page 45, line 16, replace "adjusting its gain" with -So employed or applied, the 
compensating signal preferably adjusts the gain applicable to the video signal, e.g.,--. 

Page 45, line 17, after "accomplished", insert -, typically,-- and replace "of with - 

applied to-. 

Page 45, line 18, after "response", insert -to--. 
Page 45, line 19, replace "of with -applied to-. 
Page 45, line 21 , after "image", insert a comma. 

Page 45, line 23, replace "In the event that the differential picture brightness of with ~ 
In another typical case, wherein-. 

Page 45, line 24, replace the period with a comma. 

Page 45, line 25, replace "The adder adds the sawtooth waveform," with -the video 
signal compensator typically adds, multiplies, mixes, interpolates, extrapolates orothenA^ise applies 
together one or more sawtooth waveforms and- and delete "and". 

Page 46, line 1 , replace "the video signal" with -(and, in some embodiments, the video 
signal or portion(s) thereof), such waveforms being properly balanced and othenA^ise calibrated,-; 
after "compensating signal", insert a period; and replace "which" with -The compensating signal 
typically is employed within the video signal compensator or-. 

Page 46, lines 2-3, replace "with a ...producing" with -the video signal so as to 

produce-. 

Page 46, line 4, replace "compensated video signal is used to adjust" with ~ 
compensating signal, so employed or applied, preferably adjusts--. 
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Page 46, line 5, replace "signal processor" with -signal, e.g.,--. 
Page 46, line 6, replace "of with -applied to-. 
Page 46, line 8, replace "or with -applied to-. 
Page 46, line 10, after "image", insert a comma. 
Page 46, line 20, replace "operative" with -target-. 

Page 46, line 25, replace "included as part of element 76," with -which includes, in 
one embodiment, image passing device 76 and-. 

Page 47, line 8, after "and", insert -typically-. 

Page 47, line 9, replace the comma with -and/or-. 

Page 47, line 10, after "slope", insert a comma. 

Page 47, line 1 1 , replace "parabola" with -parabolic-. 

Page 47, line 12, replace "parabola" with -parabolic-. 

Page 47, line 13, replace "An" with -Typically, an-. 

Page 47, line 14, replace the comma with -and- and delete "and a". 

Page 47, line 15, delete "video signal". 

Page 47, line 17, replace "input to a ... adjusting its gain" with -to adjust the gain 
applied to the video signal, e.g.,- 

Page 47, line 22, after "reference", insert -, thereby-. 
Page 48, lines 1-6, delete all. 

Page 48, line 9, replace "directly" with -directly or indirectly- and change "CCD sensor 
400" to -video sensor 400 (e.g., in the form of a CCD)-. 

Page 48, line 14, replace "lines" with -box-. 

Page 48, line 16, replace "or freeze frame 414 for storing" with -414 (e.g., in the form 
of a freeze frame).- 
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Page 48, line 18, replace "received" with -as received-. 
Page 48, line 22, after "digital", insert -signal-. 

Page 48, line 24, through page 49, line 2, replace "required for the differential 
...uniform brightness" with -facilitating production of a compensated video signal (i.e., a video signal 
representing an optical image having substantially uniform brightness) from a video signal 
representing an optical image having differential picture brightness.- 

Page 49, line 2, after "digital", insert -signal-. 

Page 49, lines 6-7, replace "above for... digitally" with -above-. 

Page 49, line 7, replace "form" with -from-. 

Page 49, line 9, replace "Illuminates" with -Illumination-. 

Page 49, linelO, delete "to". 

Page 49, line 14, replace "output" with -optical-. 

Page 49, line 15, replace "390 delay" with -398 delayed-. 

Page 49, line 20, replace "first inputs of the adders" with -first adder-. 

Page 50, line 1 , replace "The output video signal represents" with -These output 
signals represent-. 

Page 50, line 2, replace "a device" with -an output device, such as that-. 

Page 50, line 4, insert as new paragraphs, the following: 

-In an alternative embodiment, the structures of Figure 17 may be 
otherwise operated to produce a compensated video signal. Such embodiment contemplates a 
learning mode and an operating mode. In the learning mode, the freeze frame 414 receives a video 
signal for characterizing the differential picture brightness. The freeze frame 414 processes the 
learning-mode video signal so as to identify digital compensation coefficients for each pixel of the 
frame. As an example, the coefficients may be calculated, as follows: a) determine a reference 
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brightness for the learning mode frame(s) (e.g., an average brightness value across all or part of 
the frame, a median brightness value across all or part of the frame or otherwise) and b) dividing, for 
each pixel, the reference brightness by the pixel's actual brightness for the learning mode frame(s). 

In a preferred embodiment, the learning mode provides for detection of 
flawed or otherwise unacceptable results from the learning mode. In the event of such detection, 
the learning mode preferably supports one or more default compensations. Such default 
compensations may be variously implemented. Example implementations include: a) generating 
digital compensation coefficients that comprise a best fit (e.g., based on the learning mode data 
that appears to be without substantial flaws, at least to a threshold confidence); b) employing a 
previous set of compensation coefficients (e.g., as to all or as to part or parts of the optical image); 
c) bypassing compensation (e.g., as to all or as to part or parts of the optical image); and d) a 
combination of implementations, including of those implementation not listed above (e.g., selecting 
among previous sets of compensation coefficients to find a best fit and, if the best fit is deemed 
unacceptable, implementing a bypass). 

In the operating mode, the compensation coefficients are processed via 
the DAC 420 to generate an analog compensating signal. Concun-ently, the DSP receives a digital 
video signal from the ADC 406. The DSP processes the digital video signal and, via a digital-to- 
analog functionality, produces an analog illumination signal Yq on lead 424 and an analog color 
signal Co on lead 426. The compensating signal is applied (via adding, multiplying, mixing, 
interpolating, extrapolating or otherwise) with the illumination signal Yo and with the color signal Co, 
respectively at application components 434, 438. The application components 434, 438 produce 
compensated video signal, this signal comprising compensated illumination signal Ym (on output 
lead 440) and compensated color signal C^ (on output lead 442). 
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Although Fig. 17 shows only one compensating signal, it is understood 
that more than one compensating signal may be generated. In particular, it is contemplated that 
separate compensating signals may be generated toward compensating, respectively, the 
illumination signal Yo and the color signal Co. Moreover, although Figure 17 shows compensation as 
to Y/C formatted video signals, it is understood that compensation may be applied to a video signal 
or signal of other formats. As examples, the compensation may be applied to composite video 
signals, color differentiah signals, RGB video signals, NTSC, PAL, SECAM or any other format, 
along or in combination(s). - 

Page 50, line 7, replace "directly" with -directly or indirectly- and replace "CCD" with - 

video-. 

Page 50, line 12, replace "lines 410." with -box 41 0\ The digital signal processing 
device 410' produces a compensating signal representing at least one parameter of a compensating 
waveform facilitating production of a compensated video signal (i.e., a video signal representing an 
optical image having substantially uniform brightness) from the video signal representing an optical 
image having differential picture brightness.- 

Page 50, line 15, replace "410" with -410'-. 

Page 50, lines 15-16, change "or freeze frame 414" with -414 (e.g., in the form of a 

freeze frame)-. 

Page 50, line 17, replace "the differential" with -differential-. 

Page 50, line 20 through page 51, line 5, delete "a programmable digital processor ... 

the programmable digital processor 410' includes". 

Page 51, lines 12-13, replace "above for... digitally" with -above- 
Page 51, line 16, replace "bases" with -basis-. 
Page 51, line 17, replace "the required" with -a-. 
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Page 52, lines 3-4, replace "differential picture brightness" with -optical image 

having--. 

Page 52, line 10. at the end of the paragraph, add -It is to be understood that, while 
the color signal may remain uncompensated, the color signal typically is also compensated. ~ 

Page 52, line 1 1 , insert as new paragraphs, the following: 

-In an alternative embodiment, the structures of Figure 18 may be 
otherwise operated to produce a compensated video signal. Such embodiment contemplates a 
learning mode and an operating mode. In the learning mode, the freeze frame 414 receives a video 
signal for characterizing the differential picture brightness. The freeze frame 414 processes the 
learning-mode video signal so as to identify digital compensation coefficients for each pixel of the 
frame. The coefficients may be calculated as described above for the alternative embodiment 
based on Figure 17. 

In a preferred embodiment, the learning mode provides for detection of 
flawed or othenA/ise unacceptable results from the learning mode. In the event of such detection, 
the learning mode preferably supports one or more default compensations. Such default 
compensations may be variously implemented. Example implementations include: a) generating 
digital compensation coefficients that comprise a best fit (e.g., based on the learning mode data 
that appears to be without substantial flaws, at least to a threshold confidence); b) employing a 
previous set of compensation coefficients (e.g., as to all or as to part or parts of the optical image); 
c) bypassing compensation (e.g., as to all or as to part or parts of the optical image); d) detecting 
pixel's having sensitivity defects (e.g., individual pixels having hyper-, hypo- or no sensitivity), 
whether of individual or group(s) of pixels, so as to interpolate, extrapolate or othenA^ise treat such 
pixels isolated from other compensation (or other conditioning), and e) a combination of 
implementations, including of those implementation not listed above (e.g., selecting among previous 
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sets of compensation coefficients to find a best fit and, if the best fit is deemed unacceptable, 
implementing a bypass). 

In the operating mode, the pixel matrix multiplexer/processor 450 
receives a digital video signal from the ADC 406. The multiplexer/processor 450 also receives the 
digital compensation coefficients from the freeze frame 414, which coefficients serve as a 
compensating signal in the digital domain. The multiplexer/processor 450 digitally adds, multiplies, 
mixes, interpolates, extrapolates or otherwise applies the coefficients to the video signal. As such, 
the multiplexer/processor 450 produces a compensated digital video signal which signal is applied 
to the DSP 416. The DSP formats the video signal so as to output compensated illumination signal 
Ym (on output lead 452) and compensated color signal Cm (on output lead 454). 

As to implementations supporting learning modes, it is recognized that, 
various advantages attach. As an example, such implementations tend to enhance correction of 
asymmetrical differential brightness. As another example, such implementations tend to enhance 
correction of dynamic variations in differential brightness, such as those that may result from rotation 
of an endoscope during a procedure. As yet another example, such implementations tend to 
enhance correction of variations in differential brightness developing overtime, e.g., from the 
deteriorating performance of the endoscope, any components thereof, and/or any components of 
the system, including one or more illuminators. - 

Page 52, line 12, replace "in" with -on-. 

Page 52, line 14, after "has", insert --(a)-. 

Page 52, line 16, replace "video information signal portion" with -picture information 

portion--. 

Page 52, lines 18-19, replace "video signal portion 464 representing the picture 
information" with -picture information portion 464-. 
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Page 52, line 17, after "and", insert ~(b)--. 

Page 52, lines 19-20, change "This low level noise portion" to --These low level noise 
portions 462, 466~. 

Page 52, line 25, change "The" to -In one embodiment, the- 

Page 53, line 1 , after "after", insert -picture information portion 474 of- and replace 
"portion" with -portions-. 

Page 53, line 2, replace "before the information portion of the signal 474 has" with - 
and 474, respectively before and after the picture information portion 474, have--. 

Page 53, line 3, replace "portion of the video" with -information portion-. 

Page 53, line 4, delete "signal" in both occurrences and, before "information", insert - 

picture-. 

Page 53, lines 5-9, delete "Also, in... picture signal." 
Page 53, line 10, replace "the preferred" with -a preferred-. 
Page 53, line 17, replace "Schmidt" with -Schmitt-. 
Page 53, line 18, replace "require" with -requires-. 

Page 54, lines 3-6, replace "required for ...uniform brightness" with -to facilitate 
production of a compensated video signal (i.e., a video signal representing an optical image having 
substantially uniform brightness) from the video signal representing an optical image having 
differential picture brightness-. 

Page 54, line 6, replace "adding with an adder" with -adding, multiplying, mixing, 
interpolating, extrapolating or otherwise applying together with an adder, multiplier, mixer, 
interpolator, extrapolator or other application component-. 

Page 54, line 8, change "compensating video signal" to -compensating signal-. 
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Page 54, lines 9-10, replace "compensating signal which... processor to adjust its 
gain" with -compensated video signal. The compensating signal preferably is employed to adjust 
the gain applied to the video signal. As an example, the compensating signal applies-. 

Page 54, line 14, after "reference", insert -, thereby-. 

Page 54, line 19, delete "step of adding". 

Page 54, line 22, after "response", insert --to--. 

Page 55, line 1 , after "image", insert -, thereby--. 

Page 55, line 5, delete "step of adding". 

Page 55, line 8, after "response", insert -to-. 

Page 55, line 10, change "edge" to -center™. 

Page 55, line 1 1 , after "image", insert -, thereby-. 

Page 55, lines 13-14, change "the step of adding includes" to -the step of adding, 
multiplying, mixing, interpolating, extrapolating or otherwise applying may be accomplished using- 

Page 55, line 17, change "step of adding includes" to -step of adding, multiplying, 
mixing, interpolating, extrapolating or otherwise applying may be accomplished using 

Page 55, line 21 , change "further includes" to -may further include™. 

Page 55, line 22, delete ": (a)". 

Page 55, lines 22-23, delete "with a control device... the adder". 
Page 55, line 23, change "of to -associated with-. 

Page 55, line 25, before "For", insert -Similarly, the brightness associated with the 
output video signal may be adjusted (pre- or post-compensation) so as to have a brightness at a 
selected level below that average, or above or below a reference, or based on some selected 
calculus. To accomplish this, a control device may be employed, e.g. one operatively coupled to the 
adder, multiplier, mixer, interpolator, extrapolator or other application component.- 
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Page 56, line 1 , change "further includes" to -may further include- and delete ": (a)". 

Page 56, line 5, change "In the" to -In a-. 

Page 56, line 8, change "further" to -preferably-. 

Page 56, line 9, after "having", insert -at least one of-. 

Page 56, lines 1 1 and 12, change "parabola" to -parabolic-. 

Page 56, line 13, replace "adding with an analog signal adder"' with -adding, 
multiplying, mixing, interpolating, extrapolating or othenA/ise applying together, using an analog 
adder, multiplier, mixer, interpolator, extrapolator or other application component, one or more of-. 

Page 56, line 14, replace "wavefomi," with -and-, and replace "and the video signal" 
with -(and, in some embodiments, the video signal or portion(s) thereof)-. 

Page 56, line 15, replace "compensating" with -compensated video-. 

Page 56, line 16, change "the preferred" to -a preferred- 
Page 56, line 17, delete "used in". 

Page 56, line 21 , change "differentiated" to -differential-. 

Page 56, line 22, change "the uneven" to -uneven-. 

Page 57, line 9, change "person" to -persons-. 

Page 57, after line 11, add the following paragraphs: 

-Turning to Figure 22, depicted is a high level block diagram of a medical 
imaging instrument or system 2200, in accordance with the invention. The medical instrument or 
system 200 comprises illuminators 2212, 2212a, an image acquisition component 2214, an output 
component 2216 and a conditioning component 2218. 

In Figure 22, a target site 2210 is illuminated by illuminator 2212. As previously 
described, the target site 2210 comprises an operative site and/or an inspection area and the 
illuminator 2212 comprises one or more of light sources, light guides and the like. The target site 
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2210, for the purposes of the following description, has an associated target image. A target image 
is a representation of the target site, the representation being an optical, electronic or other signal, 
that signal being formatted consistent with signals for driving one or more relevant output devices, 
photonic devices or interface technologies (the latter terms being defined below). 

Generally, the concept of a target image expresses a goal selected for achievement. 
As an example, in the context of a video display, a target Image may be selected that correlates to a 
display image of the target site, the display image being displayed on a monitor, and wherein a) the 
target site is illuminated without deficiency (e.g., without unevenness) and b) no other component of 
the imaging instrument and system (including any video sensor, image transferring structure and 
monitor) contributes deficiencies in the acquisition, transmittal, processing and display of the image. 

The target image generally is associated with selected parameters, qualities and/or 
characteristics. These parameters, qualities and/or characteristics may extend to the entire image 
or only to parts thereof (e.g., the target image may comprise a key area that, like a spotlight, draws 
the attention of the conditioning component). As an example, the target image may be 
characterized in its omission of differential picture brightness associated with uneven illumination of 
the target site. 

It is understood that a target image may be selected that falls short (and, perhaps, falls 
substantially short) of being a perfect image of the target site. As an example, the target image may 
be flawed significantly as to other than the selected parameters, qualities and/or characteristics. As 
another example, the target image may engender a compromise among one or more parameters, 
qualities and/or characteristics, with or without a compromise as to one or more other parameters, 
qualities and/or characteristics (e.g., a best fit). 

In a specific case, a target image may be selected to con-elate to a display image of 
the target site wherein the target site is illuminated unevenly. In this case, the target image is 
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selected with attention to parameters, qualities and/or characteristics relevant to target site 
illuoiination. Moreover, the target image may or may not be selected with attention to other 
parameters, qualities and/or characteristics. (Such other parameters, qualities and/or 
characteristics, if any, otherwise may or may not have --or may be substantially without- 
deficiencies.) 

So subject to uneven illumination, this case's target image is characterized by 
differential picture brightness. The differential picture brightness may, however, be trivial in that 
spatial variations in brightness below a detection threshold are understood to be undetectable to the 
human eye. The detection threshold is subject to various factors, including factors relating to the 
output device (e.g., a printer, a display, the presentation area and dot pitch), the video sensor (e.g., 
its dynamic range), the site illumination (e.g., the intensity and energy distribution), ambient lighting, 
the quality and aperture of applicable optics (e.g., of an endoscope), the medical procedure, and the 
quality of the human eye (specifically or generally), many of which factors are quantifiable through 
empirical analysis or otherwise. 

Accordingly, a target image may be selected which has associated therewith 
undetectable or detectable differential picture brightness. In the undetectable case, the target image 
effectively is characterized by the absence of associated differential picture brightness, whether the 
selected target image correlates to a display image having differential picture brightness at, under or 
well under the detection threshold. In the detectable case, the target image typically is selected in 
connection with efforts to reduce differential picture brightness in imaging (i.e., although the flaw 
remains, it or its impact has been ameliorated). In this latter case, the target image preferably is 
selected so that the differential picture brightness, while detectable, is acceptable under selected 
criteria. As an example, the target image may be selected notwithstanding detectable differential 
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picture brightness, provided tliat flaw is insufficient to impede an applicable medical procedure or 
otlienA^ise to engender a non-trivial problem in imaging and use. 

Moreover, the detectable case explicates the nature of the compensated video signal 
of previously described camera embodiments. In such embodiments, the cameras produce 
compensated video signals which video signals represent optical images having substantially 
uniform brightness, as contrasted with uncompensated video signals representing optical images 
having differential picture brightness. In such discussions, the term "substantially uniform 
brightness" generally corresponds to the employ of a target image which itself corresponds to 
elimination of differential picture brightness, to reduction of differential picture brightness below the 
detection threshold, or to having a detectable differential picture brightness that, as determined 
under the circumstances, is acceptable under selected criteria. 

While the descriptions above focus on target images that correlate to display images, 
the correlation may be selected respecting other output devices, photonic devices or interface 
technologies, with or without a display device. In any case, a target image is a representation of the 
target site, the representation being an optical, electronic or other signal of appropriate formatting. 

The illuminator 2212 may be variously implemented. In a medical instrument such as 
an endoscope, as previously described, the illuminator 2212 may be disposed internal to the 
endoscope's housing. At the same time, the illuminator 2212 may be otherwise disposed, including 
external to the endoscope (in such case, the illuminator 2212 generally may not be considered a 
component of the instrument). In a medical system, the illuminator 2212 may be implemented so 
that the illuminator 2212 is integral with the imaging instrument or separate therefrom. 

Moreover, plural illuminators 2212 may be employed, as indicated by second 
illuminator 2212a in Figure 22. In such case, one or more illuminators 2212, 2212a may be integral 



Inventors: D'Amelio, Gunday, 
Kotlyar, Miller 



34 



Express Mail: EJ728319969US 



with the imaging instrument and/or one or more illuminators 2212, 2212a may be external to such 
instrument, or some combination of integral and external illuminators may be used. 

As previously described, the illuminators 2212, 2212a may direct selected illuminating 
frequencies onto the target site 2210. While white light is typical, it may be supplemented with, or 
substituted by, other frequencies outside the visible spectrum. These supplemental/substitute 
frequencies may be variously implemented, particularly when plural illuminators 2212 are employed. 
The supplemental/substitute frequencies may be variously employed, including, as examples, 
toward enhancing acquisition, conditioning and/or output of an image (as described below) or 
toward recognition of the target site, portion(s) thereof and/or anomalies therein (such recognition 
may also be employed in the enhancing process). 

In any case, the illuminators 2212 generally provide deficient illumination. In particular, 
illuminators 2212 typically subject the target site 2210 to uneven illumination. 

The image acquisition component 2214 generates one or more acquired images of the 
target site. An acquired image may be an optical, electronic (e.g., video) or other signal, or a 
combination thereof. An acquired image generally results from illumination of the target site 2210, as 
provided by the illuminators 2212. 

The image acquisition component 2214 may be variously implemented. The image 
acquisition component 2214 typically comprises one or more video sensors, optical image 
transferring structures, and other mechanical, optical, electronic, opto-mechanical, electro- 
mechanical, and electro-optical components. 

The image acquisition component 2214 may be variously disposed. The disposition 
depends, among other things, on its implementation and, in some cases, on the implementation of 
the output component 2216. The disposition also depends on whether the component 2214 is 
implemented as part of a medical instrument or as part of a medical system. As an example, if the 
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image acquisition component 2214 is implemented as a CCD without an optical image transferring 
structure, tlie component 2214 typically is disposed at or adjacent the distal tip of an endoscope, so 
as to generate a video signal that, via electrical connectors, is provided to either/both the 
conditioning component 2218 and the output component 2216. As another example, however, if the 
image acquisition component 2214 is implemented to include a CCD which is disposed away from 
the endoscope's distal tip or remotely from the endoscope itself, the image acquisition component 
2214 typically will be implemented also to include an optical image transferring structure, such 
structure disposed so as to receive the optical image of the target site and provide that image to the 
CCD so that the CCD may generate one or more acquired images. (Indeed, in such latter case, the 
image acquisition component 2214 generates at least two acquired images - one being an optical 
signal of the structure and another being an electronic signal from the CCD.) 

The output component 2216 generates one or more output images, the output images 
being available on output 2226. An output image may be an optical, electronic (e.g., video) or other 
signal, or a combination thereof. The output image preferably correlates to, or achieves substantial 
correlation to, the target image. As an example, if the target image is selected so as to have 
differential picture brightness that is undetectable over some portion of an image, the output image 
preferably achieves undetectability over that entire portion or over substantially all of the portion and, 
where that undetectability is not achieved respecting that portion, the output image preferably 
achieves substantial undetectability. In any case, correlation may be deemed present provided that 
the agreement of the output image with the target image is sufficient to preclude any significant 
impediment to the use of the instrument/system/method (including respecting any applicable 
medical procedure) and does not engender a non-trivial problem in imaging or related thereto. 

The output component 2216 is variously implemented. Typically, the output 
component 2216 comprises a display device (e.g., as previously described, flat panel display 
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technology, light valve technology, tube technology or otherwise), a printing device, a storage 
device, a networking device or some other output device. The output component 2216 may also 
comprise one or more optical lenses, lens groups, fiber optics (e.g., a fiber optic bundle having one 
or more optical fibers), or other photonic device. The output component 2216 may also comprise an 
interface or other connection technologies (all referred to sometimes hereinafter as "interface 
technology"), including to or with any one or more of such output devices and/or photonic devices. 
The output component 2216 may also comprise a combination of output devices, of photonic 
devices, of interface technology, or any groups of same. 

As an example, the output component 2216 may be implemented integrally with an 
endoscope. The output component 2216 may comprise an interface which directs output images 
(e.g., as formatted or unformatted video signals) to a remote output or photonic device 2228 (e.g., a 
display device). In such case, the output/photonic device 2228 typically is considered to be part of 
the medical system, but not part of the endoscope itself. Moreover, as previously described with 
respect to Figures 1 and 2, the output component 2216 may be operatively coupled to the 
endoscope, but considered separate therefrom. 

The output component 2216 is variously disposed. The disposition depends, among 
other things, on its implementation and, in some cases, on the implementation of the image 
acquisition component 2214. The disposition also depends on whether the component 2216 is 
implemented as part of a medical instrument or as part of a medical system. As an example, if the 
output component 2216 comprises a monitor or a head mounted display, that component 2216 is 
likely to be disposed remotely from an endoscope. As another example, the output component 
2216 may be integral with the endoscope, pari:icularly if implemented as a small display device (e.g., 
a miniature LCD-on-silicon display and associated optics, all integrated as the endoscope's 
eyepiece). 
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The conditioning component 2218 may also be variously implemented. Generally, the 
conditioning component 2218 provides for selective conditioning of one or more acquired images, 
one or more output images or one or more intemriediate images (such intemnediate images typically 
being derived from acquired and output images) or combinations of same. To illustrate, if the image 
acquisition component is implemented to generate acquired images comprising optical and 
electrical signals, the conditioning component generally is implemented so as to provide for 
selective conditioning of both. Similarly, if the image output component is implemented to generate 
output images comprising optical and electrical signals, the conditioning component generally is 
implemented so as to provide for selective conditioning of both. In either such case, it is preferred 
that the conditioning component provides appropriate conditioning, e.g., conditioning appropriate to 
the respective image signal and to the respective image output component. 

Although the conditioning component may apply conditioning to various images, the 
conditioning component generally is directed to enhance correlation of the output image to the target 
image. In a preferred embodiment, the conditioning component selectively reduces differential 
picture brightness across all or selected portions of the output image. In another prefen-ed 
embodiment, the target image has an associated energy profile and the conditioning component 
conditions so as to enhance correlation of the energy profile of the output image to energy profile of 
the target image. Generally, the conditioning is performed in connection with and to improve 
perfomnance in an applicable medical procedure. 

The conditioning component provides for conditioning by (i) selectively processing all 
or selected portions of at least one of the acquired image, the output image and the intermediate 
image or (ii) selectively controlling at least one the image acquisition component and the image 
output component. In the first case, the conditioning component generally provides directly for 
processing of the images, e.g. in the conditioning component itself. As an example, in the above 
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camera embodiments, the conditioning component is sometimes implemented as or within the 
video signal compensator, which compensator not only generates a compensating signal, but 
typically applies that signal to the video signal, so as to generate a compensated video signal. 

In the second case, the conditioning component provides indirectly for processing. 
To illustrate, the conditioning component may generate control signals that direct operation of a 
digital component or may generate analog signals that control (e.g., via gain circuits, active filters, 
etc.) the performance of other components' processing the applicable acquired, output or 
intermediate signal. As an example, where the image acquisition component has an acquisition 
area and has brightness sensitivity that is controllable as a function of acquisition area position, the 
conditioning component may be implemented to condition the acquired image by selectively 
controlling the brightness sensitivity of the image acquisition component. In another example, 
where the image output component has a output space and has brightness sensitivity that is 
controllable as a function of position in the output space, the conditioning component may be 
implemented to condition the output image by selectively controlling the brightness sensitivity of the 
image output component. The output space tends to be particular to the applicable output device, 
photonic device or interface technology (e.g., an output image that drives a monitor may have an 
output space correlating to the geometries of the monitor's display area). 

It is also understood that the conditioning component may be implemented to provide 
for conditioning through a combination of such selective processing and controlling. 

The conditioning component effectuates such processes or controls via selected 
signal processing. The signal processing may be conducted in the analog domain, the digital 
domain or in some combination thereof. The signal processing typically includes one or more of the 
following: amplification, attenuation, filtering, mixing, adding, multiplying, interpolating, extrapolating, 
phase shifting and frequency shifting. The signal processing may be applied to all or selected 
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portions of at least one of the acquired image, the output innage and the intermediate image. 

Moreover, the signal processing typically varies across the acquired, output and 
intermediate images. As an example, the signal processing may be directed to increasing the 
brightness in some parts of an image while decreasing it in others. These increases and decreases 
may or may not have symmetry, or may have portions of symmetry or asymmetry, across an image. 

The conditioning component preferably is responsive to the target image. That is, the 
conditioning component preferably is implemented to condition the acquired, output and/or 
intermediate images as to the parameters, qualities and/or characteristics associated with the target 
image. To do so, the conditioning component typically provides for conditioning based on one or 
more calibrations (see, e.g., the leaming modes of the alternative embodiments described above 
with reference to Figs. 17 and 18). Such calibration can be variously implemented, particularly in the 
context of a medical procedures. Example calibrations Include: calibration previous to a medical 
procedure; manual calibration performed one or more times during a medical procedure; automatic 
calibration performed at regular intervals during the medical procedure; automatic calibration 
performed at intervals during the medical procedure based on selected triggering events; and 
dynamic calibration perfomned during the medical procedure. 

Calibration may also be responsive to empirical information relevant to the medical 
procedure. As an example, calibration may be responsive to the detection threshold associated with 
differential picture brightness. Accordingly, the calibration may be directed to identify variations in 
performance relative to the detection threshold (e.g., whether the variations are detectable), and to 
provide for conditioning based thereon. 

The conditioning component 2218 may be variously disposed. The disposition 
depends on whether the component 2218 is Implemented as part of a medical instrument or as part 
of a medical system. As an example, the conditioning component 2218 may be integral, in whole or 
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part, with either the image acquisition component 2214 or the image output component 2216. As 
another example, the conditioning component 2218 may be integral, in whole or part, with both the 
image acquisition component 2214 and the image output component 2216. In this latter example, 
the image acquisition component 2214, the image output component 2216, and the conditioning 
component 2218 may be integrated in a medical imaging instrument, such that the image output 
component 2216 is an interface technology which connects the medical imaging instrument with, 
separate from the medical imaging instrument, at least one output device, photonic device and 
interface technology. 

The output component 2216 preferably is coupled with the image acquisition 
component 2214. Depending on the implementation of the conditioning component 2218, these 
components 2216, 2214 may be coupled directly (via coupling 2220), indirectly (via the conditioning 
component 2228), or both. If coupled directly, the output component 2216 preferably receives 
acquired images via the coupling 2200. If coupled indirectly, the output component 221 6 may 
receive acquired images from the conditioning component 2218 (via coupling 2224), which acquired 
images may be wholly or partially conditioned, or not conditioned at all. If the acquired images are 
partially conditioned or not conditioned, the output component 2216 preferably also receives 
appropriate conditioning signals from the conditioning component 2218, such conditioning signals 
providing for conditioning of the acquired, output or intermediate images within the output 
component 2216. Moreover, such conditioning signals may be provided via output 2226 to other 
output devices/photonic devices/interface technologies, so as to control conditioning of acquired, 
output and/or intermediate image received or generated therein. 

The invention also contemplates a method for use in imaging a target site in a 
medical procedure. In such method, the target site is subject to deficient illumination. Moreover, the 
methods responds to the target site having associated therewith a target image, that target image 
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being selected respecting the deficient illumination. The method includes the steps of generating 
an acquired image of the target site, generating an output image of the target site, and conditioning 
at least one of the acquired image, the output image and an intermediate image. The method 
preferably provides for enhanced correlation of the output image to the target image. In particular, 
the method provides for conditioning to selectively reduce differential picture brightness across all or 
selected portions of an output image. The method contemplates operations in either/both the 
analog and digital domains. 

The method contemplates conditioning provided by at least one of (1) selectively 
processing all or selected portions of at least one of an acquired image, an output image and an 
intermediate image, (ii) selectively controlling at least one of the generating of an acquired image 
and the generating of an output image, and (iii) a combination of such processing and controlling. In 
such processing/controlling, the method contemplates conditioning by providing selectively for at 
least one of amplification, attenuation, filtering, mixing, adding, multiplying, interpolation, 
extrapolation, phase shifting and frequency shifting to all or selected portions of at least one of an 
acquired image, an output image and an intermediate image. 

As an example, the method contemplates conditioning by controlling the generating 
of an acquired image and, in the specific case where an acquisition area has a brightness sensitivity 
that is controllable as a function of the acquisition area position, by selectively controlling the 
brightness sensitivity respecting the acquisition area position. As another example, the method 
contemplates conditioning by controlling the generating of an output image and, specifically in the 
case where an output space has a brightness sensitivity that is controllable as a function of position 
in the output space, by selectively controlling the brightness sensitivity respecting the output area 
position. 

Because an acquired image may be generated as an optical signal and/or as an 
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electrical signal, the method contemplates providing conditioning of either of both of these signals. 
Similarly, because an output image may be generated as an optical signal and/or as an electrical 
signal, the method contemplates providing conditioning of either of both of these signals. 
The method preferably is responsive to the target image. That is, the method preferably is 
implemented to provide conditioning of the acquired, output and/or intermediate images as to the 
parameters, qualities and/or characteristics associated with the target image. To do so, the method 
preferably provides for conditioning based on one or more calibrations (see, e.g., the learning 
modes of the alternative embodiments described above with reference to Figs. 17 and 18). Such 
calibrating can be variously implemented, particularly in the context of a medical procedures. 
Example approaches for calibrating include: calibrating previous to a medical procedure; manually 
calibrating, in particular performed one or more times during a medical procedure; automatically 
calibrating, in particular performed at regular intervals during the medical procedure; automatically 
calibrating, in particular performed at intervals during the medical procedure based on selected 
triggering events; and dynamically calibrating performed during the medical procedure. Calibrating 
may also be responsive to empirical information relevant to the medical procedure (e.g., the 
detection threshold associated with differential picture brightness). 

As previously described, the invention also contemplates a medical system wherein 
the target site is illuminated, at least in part, using frequencies other than visible light. These 
frequencies may be variously employed, including, as examples, toward enhancing acquisition, 
conditioning and/or output of an image (as described below) or toward recognition of the target site, 
portion(s) thereof and/or anomalies therein (such recognition may also be employed in the 
enhancing process). As examples, the illumination includes ultrasonic radiation and/or electro- 
magnetic radiation in the infrared and/or x-ray spectrums. Based on reflections, absorptions and/or 
transmissions of that or other such radiation, the image acquisition component preferably generates 
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an acquired image. That acquired image may be in substitution for or supplemental to an acquired 
image generated from illumination in the visible spectrum. In a particular embodiment, the 
conditioning component provides for selective conditioning of at least one of an acquired image, an 
output image and an intermediate image based on the radiation-based acquired. At the same time, 
the conditioning component typically conditions on bases other than the radiation-based acquired 
image. 

Persons skilled in the art will recognize the foregoing description and embodiments 
are not limitations, but examples. It will be recognized by persons skilled in the art that many 
modifications and variations are possible in the details, materials, and arrangements of the parts 
and steps which have been described and illustrated in order to explain the nature of this invention, 
and that such modifications and variations do not depart from the spirit and scope of the teachings 
and claims contained herein. 



IN THE DRAWINGS 

Revise Figures. 12(a), 12(b), 13(a), 13(b), 15(a), 15(b), 15(c) and 18 as shown 



in red ink on the attached sheets. 

Add new Figure 22. 



IN THE CLAIMS 

Please cancel claims 4-15, 19, 23 and 27-34, without prejudice. 
Please annend claims 24-26, as follows: 
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24. (Amended) A medical imaging system comprising: 



an endoscope having a proximal end and a distal end; 

a light guide [located within the endoscope and extending from the proximal end to 
the distal end of the endoscope], said light guide [having a light post at its proximal end 
which is] being adapted to receive light energy [from a light source]^ to transmit [the] light 
energy therealong, and to direct the light enerov from its distal end so as to illuminate [an 
operative] a target site; 

an optical image transferring [member] structure located within the endoscope and 
extending from the proximal end to the distal end of the endoscope; 

[a light source operatively connected to the light post to apply light energy to the light 

guide;] 

a video sensor operatively coupled to the optical image transferring structure at the 
distal end of the endoscope for imaging an optical image of the target site, the optical image 
having differential picture brightness due to uneven illumination of the target site : 
a_compensating apparatus operatively coupled to said video sensor the 
compensating apparatus comprising 

a sawtooth wave generator for generating a sawtooth waveform 
having a controlled amplitude and at least one of a predetermined rising 
slope[,]and a predetermined falling slope [and a controlled amplitude]; 

a [parabola] parabolic wave generator for generating a [parabola] 
parabolic waveform having a controlled amplitude and orientation; and 

an adder operatively coupled to said sawtooth wave generator, said 
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parabolic wave generator and a video signal , the adder [for] adding said sawtooth waveform, said 
parabolic waveform and said video signal to produce a compensating video 
signal [used as an input to] ; and 
a_video signal processo r coupled to the compensating apparatus so as to receive the 
compensating video signal, the compensating video signal adjusting [its] the video signal 
processor's gain both vertically and horizontall y, such that the video signal is compensated 
by increasing the gain of the video signal representing that part of the optical image which is 
less bright than a reference and reducing the gain of the video signal representing that part 
of the optical image which is brighter than a reference , so as to facilitate production of a 
compensated video signal [compensating said video signal to represent an image having a 
substantially uniform brightness]. 

25. (Amended) The system of claim [23] 2A, wherein said light guide is a fiber optic light guide 
disposed in the endoscope, said light guide resulting in [and the] differential picture 
brightness [is] so that the optical image is brighter at its center than at its edges^ and wherein 
said compensating apparatus produces a compensating [video] signal used as an input to [a] 
the video signal processo r, the compensating signal adiusting [its] the video signal 
processor's gain both vertically and horizontall y, such that the video signal is compensated 
by increasing , in response to the sawtooth waveform, the gain of the video signal [in 
response the sawtooth waveform] representing the periphery of the optical image and 
reducing , in response to the parabolic waveform, the gain of the video signal [in response to 
the parabolic waveform] representing the center of the optical image [compensating said 
video signal to represent an optical image having a substantially flat brightness]. 
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26. (Amended) The system of claim [23] 24, further comprising 
an amplifier for amplifying the compensated video signal; and 

a sensing device operatively coupled to the amplifier for receiving the compensated video 
signal and for sensing and removing noise therefrom. 

Please add new claims 35 through 1 02; 

-35. An endoscope, comprising: 

an elongate housing having a proximal end and a distal end; 

a light guide extending from the proximal end to the distal end of the housing, said light guide 
being adapted to receive light energy, to transmit the light energy therealong and to direct the light 
energy from the distal end of the housing so as to illuminate a target site wherein the target site is 
illuminated with uneven illumination; 

an optical image transferring structure extending from the proximal end to the distal end of 
the housing, the optical image transferring structure transferring an optical image of the illuminated 
target site to said proximal end; 

a video sensor operatively coupled to the proximal end of the endoscope in association with 
the optical image transferring structure, the video sensor producing a video signal representing the 
optical image having differential picture brightness due to said uneven illumination; 

a compensating apparatus operatively coupled to said video sensor, the compensating 
apparatus generating a compensating signal; and 

an application component, coupled to the compensating apparatus to receive the 
compensating signal, the application component providing for application of the compensating 
signal to the video signal so as to produce a compensated video signal. 
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36. The endoscope of claim 35, wherein the application component comprises a multiplier that 
multiplies the compensation signal and the video signal to produce a compensated video signal 
having its gain both vertically and horizontally compensated by increasing the gain of the video 
signal representing that part of the optical image which is less bright than a reference and reducing 
the gain of the video signal representing that part of the optical image which is brighter than a 
reference. 

37. The endoscope of claim 35, wherein the application component applies the compensation 
signal to control the processing of the video signal. 

38. An endoscope for imaging a target site, the target site being subject of non-uniform 
illumination, the endoscope having a proximal end and a distal end, comprising: 

a video sensor producing a video signal representing an optical image of the target site; 

a compensating apparatus operativeiy coupled to said video sensor, the compensating 
apparatus generating a compensating signal from at least part of the video; and 

an application component coupled to the compensating apparatus to receive the 
compensating signal, the application component providing for application of the compensating 
signal to the video signal toward producing a compensated video signal. 

39. The endoscope of claim 38 wherein the video sensor is disposed at the distal end of the 
endoscope. 

40. The endoscope of claim 38, wherein the video sensor is disposed at the proximal end of the 
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endoscope and further comprising optical image transferring structure, the optical image 
transferring structure transferring an optical image of the illuminated target site from the distal end to 
said video sensor at the proximal end. 

41 The endoscope of claim 38, wherein the compensating apparatus generates a digital 
compensating signal and the application component provides for applying the compensating signal 
digitally. 

42. The endoscope of claim 38, wherein the compensating apparatus generates an analog 
compensating signal and the application component provides for applying the compensating signal 
digitally. 

43 The endoscope of claim 38, wherein the compensating apparatus generates a 
compensating signal representing at least one parameter of a compensating waveform facilitating 
production of the compensated video signal. 

44. The endoscope of claim 43, wherein the compensating apparatus and the 
application component are integral. 

45. A video signal compensator for an endoscope comprising: 

a compensating signal generator, the generator generating a compensating signal 
substantially representing at least one parameter of a compensating waveform for facilitating 
reduction of differential picture brightness of an optical image generated from an interior space as 
illuminated by an illumination system in an endoscope, the interior space being subject to uneven 
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illumination, and the optical image being represented in a video signal; and 

an application component operatively coupled to said compensating signal generator 
and receiving as inputs the video signal and the compensating signal, the component applying the 
compensating signal with the video signal so that the video signal has its gain both vertically and 
horizontally compensated, including by at least one of increasing the gain of the video signal 
representing that part of the optical image which is less bright than a reference and of reducing the 
gain of the video signal representing that part of the optical image which is brighter than a reference, 
so as to produce a compensated video signal representing an image having a substantially uniform 
brightness. 

46. The video signal compensator of claim 44 wherein said compensating signal generator 
operates in the digital domain. 

47. The video signal compensator of claim 44 wherein said compensating signal generator 
operates in the analog domain. 

48. A medical instrument for use in imaging a target site in a medical procedure, the target site 
being subject to deficient illumination, and the target site having a target image selected respecting 
the deficient illumination, the medical instrument comprising: 

an image acquisition component, the image acquisition component generating an acquired 
image of the target site; 

an image output component, the image output component generating an output image of the 
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target site; and 

a conditioning component, the conditioning component being coupled to at least one of the 
image acquisition component and the image output component, the conditioning component 
providing for selective conditioning of at least one of the acquired image, the output image and an 
intermediate image derived from one or more of such acquired and output images, so as to enhance 
conrelation of the output image to the target image. 

49. A medical instrument as claimed in claim 48, wherein the image acquisition component 
comprises at least one of a video sensor and an optical image transferring structure. 

50. A medical instrument as claimed in claim 49, wherein the image output component 
comprises at least one of an output device, a photonic device and interface technologies. 

51 . A medical instrument as claimed in claim 50, wherein the conditioning component provides 
selectively for at least one of amplification, attenuation, filtering, mixing, adding, multiplying, 
interpolating, extrapolating, phase shifting and frequency shifting, such provision being to all or 
selected portions of at least one of the acquired image, the output image and the intemiediate 
image. 

52. A medical instrument as claimed in claim 48, wherein the conditioning component selectively 
reduces differential picture brightness across all or selected portions of the output image. 

53. A medical instrument as claimed in claim 48, wherein the conditioning component provides 
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for conditioning by at least one of (i) selectively processing all or selected portions of at least one of 
the acquired image, the output image and the intermediate image, (ii) selectively controlling at least 
one the image acquisition component and the image output component, and (iii) a combination of 
such selective processing and controlling. 

54. A medical instrument as claimed in claim 53, wherein the conditioning component processes 
or controls by providing selectively for at least one of amplification, attenuation, filtering, mixing, 
adding, multiplying, interpolating, extrapolating, phase shifting and frequency shifting, such provision 
being to all or selected portions of at least one of the acquired image, the output image and the 
intermediate image. 

55. A medical instrument as claimed in claim 53, wherein the image acquisition component has 
an acquisition area and has brightness sensitivity that is controllable as a function of acquisition 
area position, and wherein the conditioning component conditions the acquired image by selectively 
controlling the brightness sensitivity of the image acquisition component. 

56. A medical instrument as claimed in claim 53, wherein the image output component has an 
output space and has brightness sensitivity that is controllable as a function of position in the output 
space, and wherein the conditioning component conditions the output image by selectively 
controlling the brightness sensitivity of the image output component. 

57. A medical instrument as claimed in claim 53, wherein the conditioning component is integral, 
in whole or part, with at least one of the image acquisition component and the image output 
component 
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58. A medical instrument as claimed in claim 48, wherein the conditioning component provides 
selectively for at least one of amplification, attenuation, filtering, mixing, adding, multiplying, 
interpolating, extrapolating, phase shifting and frequency shifting, such provision being to all or 
selected portions of at least one of the acquired image, the output image and the intermediate 
image. 

59. A medical instrument as claimed in claim 48, wherein the image acquisition component has 
an acquisition area and has brightness sensitivity that is controllable as a function of acquisition 
area position, and wherein the conditioning component conditions the acquired image by selectively 
controlling the brightness sensitivity of the image acquisition component. 

60. A medical instrument as claimed in claim 59, wherein the conditioning component is integral, 
in whole or part, with the image acquisition component 

61 . A medical instrument as claimed in claim 48, wherein the image output component has an 
output space and has brightness sensitivity that is controllable as a function of position in the output 
space, and wherein the conditioning component conditions the output image by selectively 
controlling the brightness sensitivity of the image output component. 

62. A medical instrument as claimed in claim 61 , wherein the conditioning component is integral, 
in whole or part, with the image output component. 

63. A medical instrument as claimed in claim 48, wherein the conditioning component is integral, 
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in whole or part, with at least one of the Image acquisition component and the Image output 
component. 

64. A medical Instrument as claimed in claim 48, wherein the image acquisition component 
generates the acquired Image so as to comprise at least one of an optical signal and an electrical 
signal, and the conditioning component provides for conditioning of at least one of said signals. 

65. A medical instrument as claimed In claim 48, wherein the image output component 
generates an output Image comprising at least one of an optical signal and an electrical signal, and 
the conditioning component provides for conditioning of at least one of said signals. 

66. A medical instrument as claimed in claim 48, wherein the conditioning component conditions 
in at least one of the digital and analog domains. 

67. A medical Instrument as claimed in claim 48, wherein the conditioning component provides 
for conditioning based on at least one of calibration previous to the medical procedure, manual 
calibration performed one or more times during the medical procedure, automatic calibration 
performed at regular intervals during the medical procedure, automatic calibration performed at 
intervals during the medical procedure based on selected triggering events, and dynamic calibration 
perfomned during the medical procedure. 

68. A medical instrument as claimed in claim 67, wherein the conditioning component provides 
for conditioning based on calibration responsive to empirical information relevant to the medical 
procedure. 
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69. A medical system for use in imaging a target site in a medical procedure, the target site 
being subject to deficient illumination, and the target site having a target image selected respecting 
the deficient illumination, the medical system comprising: 

an image acquisition component, the image acquisition component generating an acquired 
image of the target site; 

an image output component, the image output component generating an output image of the 
target site; and 

a conditioning component, the conditioning component being coupled to at least one of the 
image acquisition component and the image output component, the conditioning component 
providing for selective conditioning of at least one of the acquired image, the output image and an 
intermediate image derived from one or more of such acquired and output images, so as to 
enhance correlation of the output image to the target image. 

70. A medical system as claimed in claim 69, wherein the image acquisition component 
comprises at least one of a video sensor and an optical image transferring structure. 

71 . A medical system as claimed in claim 70, wherein the image output component comprises at 
least one of an output device, a photonic device and interface technologies. 

72. A medical system as claimed in claim 71, wherein the conditioning component provides 
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selectively for at least one of amplification, attenuation, filtering, mixing, adding, multiplying, 
interpolating, extrapolating, phase shifting and frequency shifting, such provision being to all or 
selected portions of at least one of the acquired image, the output image and the intermediate 
image 

73. A medical system as claimed in claim 69, wherein the conditioning component selectively 
reduces differential picture brightness across all or selected portions of the output image. 

74. A medical system as claimed in claim 69, wherein the conditioning component provides for 
conditioning by at least one of (i) selectively processing all or selected portions of at least one of the 
acquired image, the output image and the intermediate image, (ii) selectively controlling at least one 
the image acquisition component and the image output component, and (iii) a combination of such 
selective processing and controlling. 

75. A medical system as claimed in claim 74, wherein the conditioning component processes or 
controls by providing selectively for at least one of amplification, attenuation, filtering, mixing, adding, 
multiplying, interpolating, extrapolating, phase shifting and frequency shifting, such provision being 
to all or selected portions of at least one of the acquired image, the output image and the 
intermediate image. 

76. A medical system as claimed in claim 74, wherein the image acquisition component has an 
acquisition area and has brightness sensitivity that is controllable as a function of acquisition area 
position, and wherein the conditioning component conditions the acquired image by selectively 
controlling the brightness sensitivity of the image acquisition component. 
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77. A medical system as claimed in claim 74, wherein the image output component has an 
output space and has brightness sensitivity that is controllable as a function of position in the output 
space, and wherein the conditioning component conditions the output image by selectively 
controlling the brightness sensitivity of the image output component. 

78. A medical system as claimed in claim 74, wherein the conditioning component is integral, in 
whole or part, with at least one of the image acquisition component and the image output 
component. 

79. A medical system as claimed in claim 69, wherein the conditioning component provides 
selectively for at least one of amplification, attenuation, filtering, mixing, adding, multiplying, 
interpolating, extrapolating, phase shifting and frequency shifting, such provision being to all or 
selected portions of at least one of the acquired image, the output image and the intermediate 
image. 

80. A medical system as claimed in claim 69, wherein the image acquisition component is 
implemented as part of a medical imaging instrument and separate from the medical imaging 
instrument is at least one of the image output component and the conditioning component. 

81 . A medical system as claimed in claim 80, wherein the image output component is an 
interface technology which connects the medical imaging instrument with, separate from the medical 
imaging instrument, at least one output device, photonic device and interface technology. 
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82. A medical system as claimed in claim 69, wherein the image acquisition component, the 
image output component, and the conditioning component are integrated in a medical imaging 
instrument, and wherein the image output component is an interface technology which connects the 
medical imaging instrument with, separate from the medical imaging instrument, at least one output 
device, photonic device and interface technology. 

83. A method for use in imaging a target site in a medical procedure, the target site being 
subject to deficient illumination, and the target site having a target image selected respecting the 
deficient illumination, the method comprising: 

generating an acquired image of the target site; 

generating an output image of the target site; and 

conditioning at least one of the acquired image, the output image and an intermediate image 
derived from one or more of acquired and output images, so as to enhance correlation of the output 
image to the target image. 

84. A method as claimed in claim 83, wherein the conditioning is provided selectively via at least 
one of amplification, attenuation, filtering, mixing, adding, multiplying, interpolating, extrapolating, 
phase shifting and frequency shifting to all or selected portions of at least one of an acquired image, 
an output image and an intermediate image. 

85. A method as claimed in claim 83, wherein the conditioning selectively reduces differential 
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picture brightness across all or selected portions of an output image. 

86. A method as claimed in claim 83, wherein the conditioning is provided by at least one of (i) 
selectively processing all or selected portions of at least one of an acquired image, an output image 
and an intermediate image, (ii) selectively controlling at least one of the generating of an acquired 
image and the generating of an output image, and (ill) a combination of such processing and 
controlling. 

87. A method as claimed in claim 86, wherein the processing or controlling is effected by 
providing selectively for at least one of amplification, attenuation, filtering, mixing, adding, 
multiplying, interpolating, extrapolating, phase shifting and frequency shifting to all or selected 
portions of at least one of an acquired image, an output image and an intermediate image. 

88. A method as claimed in claim 86, wherein controlling the generating of an acquired image 
contemplates using an acquisition area having a brightness sensitivity that is controllable as a 
function of the acquisition area position, and wherein the conditioning of the acquired image 
comprises selectively controlling the brightness sensitivity respecting the acquisition area position. 

89. A method as claimed in claim 86, wherein controlling the generating of an output image 
contemplates using an output space having a brightness sensitivity that is controllable as a function 
of position in the output space, and wherein the conditioning of the output image comprises 
selectively controlling the brightness sensitivity respecting the output area position. 

90. A method as claimed in claim 83, wherein generating an acquired image contemplates using 
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an acquisition area having a brightness sensitivity that is controllable as a function of the 
acquisition area position, and wherein the conditioning of the acquired image comprises selectively 
controlling the brightness sensitivity respecting the acquisition area position. 

91 . A method as claimed in claim 83, wherein generating an output image contemplates using 
an output space having a brightness sensitivity that is controllable as a function of position in the 
output space, and wherein the conditioning of the output image comprises selectively controlling the 
brightness sensitivity respecting the output space position. 

92. A method as claimed in claim 83, wherein the generating of an acquired image comprises 
generating at least one of an optical signal and an electrical signal, and wherein the conditioning is 
of at least one of said signals. 

93. A method as claimed in claim 83, wherein the generating of an output image comprises 
generating at least one of an optical signal and an electrical signal, and wherein the conditioning is 
of at least one of said signals. 

94. A method as claimed in claim 83, wherein the conditioning is performed in at least one of the 
digital and analog domains. 

95. A method as claimed in claim 83, wherein the conditioning is based on at least one of 
calibration previous to the medical procedure, manual calibration performed one or more times 
during the medical procedure, automatic calibration performed at regular intervals during the 
medical procedure, automatic calibration performed at intervals during the medical procedure based 
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on selected triggering events, and dynamic calibration performed during the medical procedure. 

96. A method as claimed in claim 95, wherein the conditioning is based on calibration responsive 
to empirical information relevant to the medical procedure. 

97. A medical system for use in imaging a target site in a medical procedure, the target site 
being subject to deficient illumination, and the target site having a target image selected respecting 
the deficient illumination, the target image having an energy profile, the medical system comprising: 

an image acquisition component, the image acquisition component generating an acquired 
image of the target site, the acquired image having an energy profile; 

an image output component, the image output component generating an output image of the 
target site, the output image having an energy profile; and 

a conditioning component, the conditioning component being coupled to at least one of the 
image acquisition component and the image output component, the conditioning component 
providing for selective conditioning of the energy profile of at least one of the acquired image, the 
output image and an intermediate image derived from one or more of such acquired and output 
images, so as to enhance correlation of the energy profile of the output image to energy profile of 
the target image in connection with and to improve performance in the medical procedure. 

98. A medical system as claimed in claim 97, wherein the target site is illuminated, at least in 
part, using signals other than visible light, and wherein the image acquisition component generates 
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a second acquired image of the target site based on the illumination using other then visible light. 

99. A medical system as claimed in claim 98, wherein the illumination is electro-magnetic 
radiation in the infrared spectrum and the image acquisition component generates a second 
acquired image based on reflections and absorptions of said radiation. 

100. A medical system as claimed in claim 98, wherein the illumination is ultrasonic radiation and 
the image acquisition component generates a second acquired image based on reflections and 
absorptions of said radiation. 

101 . A medical system as claimed in claim 98, wherein the conditioning component provides for 
selective conditioning of the energy profile of at least one of thfe acquired image, the output image 
and an intermediate image based at least in part on the acquired image generated from the 
illumination other than visible light. 

102. A medical system as claimed in claim 97, wherein the conditioning component provides for 
selective conditioning of the energy profile so as to reduce differential picture brightness across all 
or selected portions of the output image. - 

REMARKS 

This Amendment is filed preliminary to the examination of the continuing application 
which is being filed concurrently. The continuing application is a continuation-in-part of pending 
application number 09/228,773, filed January 11, 1999, which is a division of application number 
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08/791 ,637, filed January 31 , 1 997, now abandoned. The continuing application is filed by re-filing 
the original specification of application 08/791, 637, and amending same with this Amendment. 

In this Amendment, Applicant has amended the specification, including Figures. The 
amendments include cancellation of claims 4-15, 19, 23 and 27-34, without prejudice. The 
amendments also include revision and addition of claims so as to explicate and clarify the subject 
matter claimed. The amendments also include addition of new Figure 22. The amendments 
includes corrections of the original specification so as to explicate and supplement the disclosures 
thereof. Applicant submits that all claims remaining in the case are supported by the specification, 
including as amended above. 

Applicant notes that the ultimate parent application included a restriction requirement 
by which original claims 1-3, 16-18 and 20-22 were classified in Group I and original claims 24-26 
were classified in Group IV. However, in prosecution of that parent, the separate classification of 
such claims was traversed. Moreover, the Examiner acceded to the traversal. Accordingly, the 
Examiner re-grouped claims 1-3, 16-18, 20-22 and 24-26 together, entitling Applicant to prosecute 
such subject matter in one case. Applicant has chosen to so prosecute such subject matter with this 
application. 



Inventors: D'Amelio, Giinday, 
Kotlyar, Miller 



63 



Express Mail: EJ728319969US 



Applicant requests that the Examiner (i) enter this Amendment, (ii) consider this 
continuing application, (iii) allow the remaining claims, including the new and amended claims, and 
(iv) pass this case to issue. 

Applicant invites the Examiner to contact the undersigned by telephone to discuss any 
issues related to this Application. 

Respectfully submitted, 




Tel. No. (503) 297-8699 
August 26, 1999 
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A VIDEO SIGNAL COMPENSATOR FOR COMPENSATING 
DIFFERENTIAL PICTURE BRIGHTNESS OF AN OPTICAL 
IMAGE DUE TO UNEVEN ILLUMINATION AND METHOD 
ABSTRACT OF THE DISCLOSURE 
A video signal compensatoar and method for- compensating fonr 
differential picture brightness of an optical image due to uneven 
illumination is shown. The video signal compensator includes a 
device for generating a compensating signal substantially 
representing at least one parameter of a compensating waveform 
required to produce a video signal representing an optical image 
having a substantially uniform brightness. An adder operatively 
coupled to the compensating signal generating device and a video 
signal adds the compensating signal and the video signal to 
produce a compensating video signal used as an input to a video 
signal processor adjusting its gain both vertically and 
horizontally compensated by increasing the gain of the vzudeo 
signal representing that part of the optical image which is less 
bright than a reference and reducing the gain of the video signal 
representing that part of the optical image which is brighter 
than a reference compensating the video signal to represent an 
optical image having a substantially uniform brightness. The 
compensating signal can be generated by either an analog signal 
generating device or a digital signal processing device. 
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A VIDEO SIGNAl. COMPENSATOR FOR COMPENSATING 
DIFFERENTIAL PICTURE BRIGHTNESS OF AN OPTICAL 
IMAGE DUE TO UNEVEN ILLUMINATION AND METHOD 
BACKGROUND OF THE INVENTION 
1 . Field of the Invention 

This invention ^relates to a video signal compensator for* 
compensating- a video signal for differential picture brightness 
of an optical image and more particularly relates to a video 
signal compensator for compensating a video signal for 
differential picture brightness of an optical image due to uneven 
illumination. In the preferred embodiment, the video signal 
compensator compensates for differential picture brightness of an 
optical image from an endoscope which is brighter at its center 
than at its periphery. The optical image from the endoscope is 
imaged onto a video sensor* 
2 . Description of the Prior Art 

A wide variety of optical instruments are used to generate 
optical images. In the medical field, endoscopes are used in 
performing surgical procedures, such as minimally invasive 
surgery, to generate optical images from within a body cavity. 

In the industrial field, borescopes are used to inspect 
interior spaces, such as the interior stage of a jet engine, 
which are generally inaccessible. Other optical instruments are 
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used foar pearf oirmlng- such routine tasks as inspecting interiors of 
sewer lines, ventilation systems, pipe lines and other elongated 
cavities . 

Typically, such, optical instruments have a video camera 
operatively coupled to the proxiimal end thereof to receive the 
optical image and to produce an video signal of the optical 
image. The video signal is typically processed by a video signal 
processor and displayed on a video monitor or stored by a video 
storage device. 

It is also knovm in the art that a video sensor may be 
integral with the proximal end of an optical instrument . The 
output of the video sensor in such an instrument is typically 
applied to a video signal processor which processes the video 
signal to produce a video output signal which is applied to a 
video monitor. One example of such an instrument is a Video 
Operating Liaparoscope offered for sale and sold by CIRCON ACMI 
Division of Circon Corporation, the assignee of the present 
invention . 

It is also well known in the art that body cavities, hidden 
or inaccessible spaces and elongated cavities are either dark or 
have such low light levels that it is difficult for optical 
instruments to produce an optical image that can be 
satisfactorily imaged by a video camera or video sensor. 

In order to overcome these problems, a wide variety of light 
sources have been developed to produce light energy at light 



-3- 



255 012797 7256 613100/1580 

levels that provide sufficiently high light levels of 
illumination in the body cavities, hidden or inaccessible spaces 
and elongated cavities • A sufficiently high light level enables 
the optical instruments to produce an optical image of the 
operative site and to transmit the optical image to the proximal 
end of the optical instrument enabling the optical image to be 
imaged by the video camera or video sensor. 

In order to accomplish the above, the optical instruments 
typically include a light guide, such as for example a fiber 
optic light guide, to transmit light energy from a light source 
thiroiagh the proximal end of and thorough the instrument to the 
distal end thereof. The light energy is used to illuminate the 
operative site or area subject to inspection. The optical image 
is then transmitted by an optical image transferring system from 
the distal end of and through the instrument to the proximal end 
thereof where the optical image is directed on the video camera 
or video sensor. 

It is also known in the art that the endoscope may have an 
illumination source located at the distal end of the endoscope. 
One of the known prior art laparoscopes had a light bulb located 
at the distal end of the laparoscope wherein electrical 
conductors extending from the distal end to the proximal end of 
the laparoscope energized the light bulb to illuminate the 
operative site or area subject to inspection. Illumination from 
the light bulb located at the distal end of the endoscope 
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produced uneven illumination due to th.e characteristics of the 
light energy emanating from the light bulb. 

It is also known in the art to locate a video sensor, such 
as a CCD chip, on the distal end of a optical instrument- Such a 
structure eliminates the use of a optical image transferring 
system or member. However, such optical instruments still 
require a light guide to transmit light energy from a light 
source to the distal end thereof to illuminate the operating site 
or area subject to inspection. Electrical conductors located 
within the optical instrument transmit the video signal from the 
distal tip of and through the instrument to a video signal 
compensator . 

It has been observed that when an optical instrument is used 
in combination with a light guide, or distally located 
illumination source, the resulting optical image from the optical 
instrument has differential picture brightness due to uneven 
illumination at the distal end thereof. 

For example, a typical medical endoscope, having a fiber 
optic light guide, have diameters generally in the order of about 
5 mm to about 10 mm or larger at the distal end. Such endoscopes 
generally produce an optical image that is brighter in the center 
and dim on the periphery or edge. In smaller diameter endoscopes 
having a fiber optical light guide, for example endoscopes having 
a diameter at the distal end of less that 5 mm, the optical image 
may be saturated at the center. 
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One known design approach to solve the differential picture 
brightness problem is to modify the structure and characteristics 
of the light guide, the optical image transferring system or 
member or modify both in an attempt to obtain a more uniform 
brightness of the optical image developed by the optical 
instrument itself. 

The fiber optic light guides and optics of the optical image 
transferring systems have been optimized, but, however, the 
differential picture brightness piroblem still persists. 
2 The primary cause for the differential picture brightness 

fy problem has now been identified to be other than the optical 
instrument* It has now been identified that it is the light 
Hi source itself which generates a light energy or light radiation 
Zr% - having a peaked characteristic curve with a bright spot in the 
center thereof and a dim periphery or edge. When the light 
source is operatively coupled to the light guide, e.g. the fiber 
optic light guide in an endoscope, the transmitted light energy 
retains the characteristics of the light source; namely, a bright 
spot in the center thereof and a dim periphery or edge . In 
essence, each optical instrument reproduces the characteristic 
curve of the light source and this results in an optical image 
having a differential picture brightness due to uneven or non- 
uniform illumination* 
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Unsuccessful attempts have been made to design or* modify the 
light souirce to ^reduce or eliminate the above described 
deficiencies . 

In addition to the above and as is well known in the art, 
variations in the operating characteristics of the video sensor 
or video camera generating the video signals . representing optical 
images introduce shading into the video signal. The combination 
of the light source problems and shading problems have resulted 
in poor quality optical images which, in turn, produce poor 
qriality electronic optical images. 

It is known in the prior art that vidicon tube cameras, such 
as for example, a Sony video tube cameras, have used a shading 
circuit to compensate for the variations in the operating 
characteristics of the vidicon tube itself (the '^Sony Vidicon 
Shading Circuit" ) * The Sony Vidicon Shading Circuit used a 
parabolic waveform and a sawtooth waveform to generate a 
compensating signal which adjusts the video signal as required to 
overcome the variations of the vidicon tube operating 
characteristics . 

United States Patent 5,343,3 02 discloses a video camera 
which includes a correction circuit in which a parabolic wave 
signal is generated and the level thereof is adjusted in 
accordance with the zoom and iris settings of the camera's 
optical system. After adjustment, the parabolic wave signal is 
clipped in accordance with a reference level and the clipped 
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parabolic wave signal is used for correcting the shading of the 
camera's image signal. The clipping of the parabolic correction 
signal allows for a more accurate shading correction. The 
shading correction circuit performs the shading corrections 
principally in the case of the reduction of the light intensity 
ratio from the peripheiry to the center of the image caused by 
aperture eclipse and in the case of f-drop (i.e. reduction of the 
f -number) at the telephoto lens setting. 

United States Patent 5^157,497 discloses a method and 
^ apparatus for detecting and compensating for white shading errors 

in a digitized video signal using a flat white calibration 
s target . The correction system is capable of automatically 
O determining the amount of white shading correction to be applied 
to specific video image pixels as well as the application of that 
correction to a digitized video signal. The system includes an 
inspecting portion for identifying the required correction within 
a video frame, a calculating portion for computing the amount of 
correction to be applied to the video signal, and a correction 
portion for correcting the video signal based upon the correction 
computed by the calculating portion. 

United States Patent 5,053,879 discloses a method and device 
for shading correction used in a video printer comprising a TV 
camera for providing image data of a subject to be printed and an 
exposure CRT for displaying the image data thereon and to which 
photographic paper is exposed to make a video printout of the 
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subject. In carrying out the shading correction method, the 
shading correction device employs a memory for storing the 
shading correction data, a frame memory for storing image date of 
a subject to be printed and a device for adding the shading 
correction data read out from the memory and the image data 
readout from the memory. 
^ United States patents 4,979,598 and^\4 , 979 , 042 disclose 

apparatus for correcting shading effects in video images for a 
^fl document retrieval system. The document retrieval system 

captures an image of a document in electronic form using linear 
S^J CCD imagers or a CCD array. The apparatus reduces the size of 
s the memory required to store correction information by defining 
ro the two dimensional non-uniformity characteristics in terms of 
^ two functions that are orthogonal. The orthogonal correction 
functions are stored in separate memories. During a scan, a 
pixel counter addresses the X memory while a line counter 
addresses a Y memory. The correction factors thus obtained are 
applied sequentially to corr-ect the pixel data value at the 
current X and Y coordinates. The sources of non-uniformity which 
are corrected by the apparatus include use of the lens having 
non-uniformities which are generally known in the optical art as 
the '^cos" law (sometimes known as the cosine law) to focus the 
image onto the capturing device and, the CCD pixel sensitivity 
variations and spot uniformities that may occur in an 
illumination source such as a lamp filament. 
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The above described prior art represent the typical 
electronic correction devices and methods to cozrirect shading in 
an optical imag-e for a variety of video imaging apparatus and 
system . 

SUMMAFLY OF THE INVENTION 
A novel, new and tiniqiae compensating apparatus or video 
signal compensator for compensating differential picture 
brightness of an optical image due to uneven illumination is 
disclosed and taught by this invention. The compensating 
apparatus or video signal compensator includes a device for 
generating a compensating signal substantially representing at 
least one pairameter of a compensating waveform required for the 
differential picture brightness of an optical image to produce a 
video signal representing an optical image having a substantially 
uniform brightness. An adder is operatively coupled to the 
compensating video signal generating device and a video signal 
for adding the compensating signal and the video signal to 
produce a compensating signal used as an input to a video signal 
processor adjusting its gain both vertically and horizontally by 
increasing the gain of the video signal representing that part of 
the optical image which is less bright than a ^reference and 
reducing the gain of the video signal representing that part of 
the optical image which is brighter than a reference. The 
compensated video signal represents an image having a 
substantially uniform brightness. 
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In addition, a new novel and unique metbiod for compensating 
for differential picture brightness of an optical image due to 
uneven illumination is discloses and taught by this invention. 
The method comprises the steps of: (a) generating with a 
compensating signal device a compensating signal substantially 
representing at least one parameter of a compensating waveform 
required for the differential picture brightness of an optical 
image to produce a video signal representing an optical image 
having a substantially uniform brightness; and (b) adding with an 
adder operatively coupled to the compensating signal generating 
device and a video signal the compensating signal and the video 
signal to produce a compensating video signal used as an input to 
a video signal processor adjusting its gain both vertically and 
horizontally compensated by increasing the gain of the video 
signal representing that part of the optical image which is less 
bright than a reference and reducing the gain of the video signal 
representing that part of the optical image which is brighter 
than a reference compensating the video signal to represent an 
optical image having a substantially uniform brightness. 

In the preferred embodiment of the apparatus and method of 
the present invention, the differential picture brightness of an 
optical image is brighter at its center than at its periphery or 
edges. Thus, the compensating video signal is used to adjust the 
gain of the video signal processor both vertically and 
horizontally by increasing the gain of the video signal in 
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response to a sawtooth waveform representing the periphery or 
edges of the optical image and reducing the gain of the video 
signal in response to the parabolic waveform representing the 
center of the optical image compensating the video signal to 
represent an optical image having a substantially flat 
brightness . 

In the Sony Vidicon Shading Circuit, the sawtooth wave 
generator and parabolic wave generator were used to generate a 
'^compensating signal to correct for the deficiencies introduced 
f^nto or added into the video signal by the vidicon tube itself . 
#he Sony Vidicon Shading Circuit was not used to correct for 
differential picture brightness of an optical image due to uneven 

^lumination from an optical instrument imaged onto a vidicon 

fy 

tpbe or sensor . 

The correction circuit of United States Patent 5,343,302 
generated a parabolic wave signal and the level thereof was 
adjusted in accordance with the zoom and iris settings of the 
camera's optical system. Further, the parabolic wave signal of 
the correction circuit of United States Patent 5,343,302 was 
clipped to perform shading corrections principally in the case of 
the reduction of the light intensity ratio from the periphery to 
the center of the image caused by aperture eclipse and in the 
case of f-drop (i.e. reduction of the f -number) at the telephoto 
lens setting. The correction circuit of United States Patent 
5,343,302 was not used to correct for, nor does the correction 
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circuit therein disclose, suggest or teach compensating for 
differential picture brightness of an optical image from an 
optical instrument imaged onto video camera or sensor. 

The method and apparatus of United States Patent 5,157,497 
detects and compensates for white shading errors in a digitized 
video signal using a flat white calibration target. The method 
and apparatus of United States Patent 5,157,497 was based on use 
of a flat white calibration target and was not used to correct 
for differential picture brightness of an optical image from an 
optical instrument imaged onto video camera or sensor. 

The shading correction device disclosed in United States 
Patent 5,053,879 is used for a video printer and employs a memory 
for storing the shading correction data, a frame memory for 
storing image date of a subject to be printed and a device for 
adding the shading correction data read out from the memory and 
the image data readout from the memory. The shading correction 
device of United States Patent 5,053,879 is based on adding 
shading correction data read out from the memory with the image 
data readout from the memory. United States Patent 5,053,879 
does not disclose, teach or suggest correcting for differential 
picture brightness of an optical image having uneven illumination 
from an optical instrument imaged onto video camera or sensor. 

The apparatus and method disclosed in United States [patents 

4,979,598 and^. 4 , 979 , 042 disclose and teach correction of shading 

- \ 

effects in video images for a document retrieval system. The 
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document retrieval system capture an image of a document in 
electronic form using linear CCD imagers or a CCD array. The 
apparatus defines the two dimensional non-uniformity 
characteristics in terms of two functions that are orthogonal 
alDOUt orthogonal axes. The sources of non-uniformity which are 
corrected by the apparatus compensate for lens deficiencies, the 
CCD pixel sensitivity variations and spot non-uniformities that 
may occur in an illumination source such as a lamp filament. The 
apparatus and method disclosed in United States [patents 4, 979,598 
and\4 , 979 , 042 do not teach, disclose or suggest compensating 
differential picture brightness of an optical image due to uneven 
illumination from an endoscope imaged onto a video camera. 

The prior art does not disclose, teach or suggest 
compensating video images for the non-uniform characteristics of 
a light source located at or transmitted by a light guide to the 
distal end of an optical instrument to illuminate an operative 
site or inspection area. 

The apparatus and method of the present invention overcomes 
several of the problems of the prior art including compensating 
for differential picture brightness due primarily to the non- 
uniform characteristics of a light source located as or 
operatively coupled to a light guide for illumination of an 
operative site or inspection area. The light energy is typically 
reflected from the surface of the operative site or inspection 
area. The reflected light energy and optical image developed 
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theirefiTom in an optical instarument include the non-uniformities 
or unevenness of the light energ-y. 

One advantage of the present invention is that the 
compensation correction apparatus and method can be used for 
optical images developed form a variety of optical instruments 
including endoscopes having an optical imager imaged onto a video 
sensor or video camera . 

Another advantage of the present invention is that the 
amount and shape required for compensation correction can be 
adjusted as required or an approximation thereof can be provided 
with adjustable wave shaping devices or circuits. 

Another advantage of the present invention is that optical 
instruments developing an optical image having differential 
picture illumination with an uneven light return path and light 
and dark areas which are imaged onto a video sensor or video 
camera can have the so produced optical images compensated 
electronically such that the brightness of the areas is more 
uniform or flat. 

Another advantage of the present invention is that a 
sampling circuit or sensing circuit may be used to determine the 
correction required for appropriate compensation or an 
approiximat ion thereof and such circuits can be used with 
adjustable wave shaping devices or circuits. 

Another advantage of the present invention is that a the 
light returned from the cosine angle of the reflecting surface 
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can be sampled or sensed and a correction iDased thereon can be 
developed and applied to video amplifiers to reduce the gain in 
the brig-ht areas and increase the gain in the dark areas to 
produce a video signal representing an optical image having 
substantially even field illumination. 

Another advantage of the present invention is that the 
compensating signal reqijiired for making the corrections and the 
means for applying the compensating signal may be analog, digital 
or other means, e.g., a hybrid of analog and digital. 

Another advantage of the present invention is that a video 
signal compensator can produce corrections wherein the 
differential picture brightness of an optical image is brighter 
at its center than at its periphery or edges. The video signal 
compensator includes an adder which adds a sawtooth waveform, a 
parabolic waveform and a video signal to produce a compensating 
signal used as an input to video signal processor adjusting a its 
gain both vertically and horizontally by increasing the gain of 
the video signal in response the sawtooth waveform representing 
the periphery of the optical image and reducing the gain of the 
video signal in response to the parabolic waveform representing 
the center of the optical image compensating the video signal to 
represent an optical image having a substantially flat 
brightness . 

Another advantage of the present invention is that a video 
signal compensator can produce corrections wherein the 
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dif f eirential picture brightness of an optical image is brighter 
at its periphery or edges than at its center. The video signal 
compensator includes an adder which adds a sawtooth waveform^ a 
parabolic waveform and a video signal to produce a video 
compensating signal used as an input to a video signal processor 
adjusting its gain both vertically and horizontally by decreasing 
the gain of the video signal in response the sawtooth waveform 
representing the periphery of the optical image and increasing 
the gain of the video signal in response to the parabolic 
waveform representing the center of the optical image 
compensating the video signal to represent an optical image 
having a substantially flat brightness. 

Another advantage of the present invention is that a video 
signal compensator can include a control device operatively 
coupled to an adder to increase the brightness of the output 
video signal- to a level which is greater than the average of the 
differential brightness of the optical image due to the uneven 
illumination . 

Another advantage of the present invention is that a video 
signal compensator can be used for compensating differential 
picture brightness of an optical image due to uneven illumination 
from an endoscope imaged onto a video sensor or video camera . 

Another advantage of the present invention is that a method 
for compensating for differential picture brightness of an 
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optical image due to uneven illumination using a video signal 
compensator- is shown . 

Anotheir advantage of the piresent invention is that a method 
for compensating for an uneven light path in an endoscope or 
other optical instrument is shown. The method for compensating 
can be used to compensate for non-uniformities of the optical 
system alone or in combination with an illumination system having 
non-uniformities as used in television viewing systems. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other advantages of this invention will be 
apparent from the following description of the preferred 
embodiment of the invention when considered with the 
illustrations and accompanying drawings which include the 
following Figures : 

Fig. 1 is a front, top and left end perspective view of a 
endoscope in the form of a laparoscope having a video camera 
operatively coupled to an eyepiece located at the proximal end 
thereof for practicing this invention; 

Fig. 2 is a partial top plan sectional view showing the 
proximal end of another embodiment of a laparoscope having a 
video sensor directly operatively attached thereto for practicing 
this invention; 

Fig, 3 is a distal section perspective view of on embodiment 
of a laparoscope of Fig. 1 showing the distal tip having a 
transparent member for passing an optical image, the location of 
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the fiber- optic light guide around the periphery of the 

laparoscope and two nozzles for directing fluid across the 

exterior surface of the transparent member; 

Fig. 4 is a distal end elevational view showing another 

embodiment of a laparoscope having a single nozzle for directing 

fluid across the exterior surface of the transparent member and 

the location of the fiber optic light guide around the periphery 

of the laparoscope and nozzles- 
Fig. 5 is a distal end elevational view of yet another 

embodiment of Fig, 4 showing an additional working channel and 

orientation of the fiber optic light guides- 
Fig. 6- is a distal end elevational view of yet another 

embodiment of Fig. 5 having a fourth channel and orientation of 

the fiber optic light guides- 
Fig. 7 is a distal end elevational view of yet another 

embodiment of a laparoscope having a nozzle, an irrigation flow 

orifice, which could be utilized as a first working channel, and 

an accessory or working channel which is larger that the first 

channel and which is adapted to pass working accessories and 

orientation of the fiber optic light guides- 
Fig. 8 is block diagram of an analog video camera having the 

video signal compensator located between a preamplifier and video 

signal processors- 
Fig. 9 is a block diagram of a digital video camera having a 

preamplifier, digital-to-analog converter, digital signal 
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processing, analog-to-digital convertier with the video signal 
processor located after the analog- to-digital converter; 

Fig. 10 is a block diagram of another emJDodiment of a 
digital video camera having a preamplifier, video signal 
compensator, digital-to-analog converter, digital signal 
processor, analog- to-digital converter and a monitor illustrating 
that the video signal processor is located before the analog-to- 
digital converter; 

Fig. 11 is a block diagram of another embodiment of a analog 
video camera having a video sensor, preamplifier, analog video 
signal processor, video signal compensator and a monitor 
illustrating that the video signal processor is located after the 
analog video signal processor; 

Fig. 12(a) and Fig. 12(b) represent graphs showing: (i) the 
brightness of the optical image represented by a video signal 
having a differential picture brightness where the center is 
brighter than a reference level and the periphery is less bright 
than a reference level; and (ii) the brightness of the optical 
image represented by a video signal after adjustment by the video 
signal processor in response to a compensating signal which has 
been added to the video signal compensating the video signal to 
represent the optical image having a substantially uniform 
brightness , respectively; 

Fig. 13(a) and Fig. 13(b) are pictorial representations of: 
(i) an optical image wherein the center is brighter than a 



-20- 



255 012797 7256 613100/1580 

refer-ence level and the periphery is less bright than a reference 
level and of an optical image wherein the center is less bright 
than a reference level; and (ii) the periphery is brighter than a 
reference level, respectively; 

Fig. 14 is a pictorial representation of a compensated video 
signal of an optical image having a substantially uniform 
brightness ; 

Figs. 15(a) , 15(b) and 15(c) are waveforms of a sawtooth 
C wave generator having an increasing slope, a waveform of a 
n sawtooth wave generator having an decreasing slope and a waveform 
St of a parabolic wave generator having controlled amplitude and 
I" orientation, respectively; 

ffi Fig. 16 is a schematic diagram of the preferred embodiment 

^J} of a video signal compensator of the present invention adapted to 
be located in a video camera at a location illustrated in Fig. 8; 

Fig. 17 is a block diagram of a digital video camera having 
a digital storage device for storing a digital representation of 
the video signal having the differential brightness due to uneven 
illumination cross - sect ional and a digital signal processor for 
generating a digital compensating signal which is converted by a 
digital-to-analog converter to an analog signal before being 
applied to an adder to produce a compensated analog video output 
signal from the digital signal processor; and 

Fig. 18 is a block diagram of a digital video camera having 
a different embodiment of a video signal compensator having a 
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digitial storage device foar stor-ing a digital r-epr-esentation of 
the video signal having the differential brightness due to uneven 
illumination cross - sectional and a programmable digital processor 
having an 8x8 pixel multiplexer/processor for producing a 
compensated analog video output signal; 

Fig. 19 is a waveform of a video signal from a small 
diameter endoscope illustrating the noise before and after the 
video signal representing the picture information; 

Fig. 2 0 is a waveform of the video signal from a small 
diameter endoscope illustrating the action of a sensing device 
for sensing and removing the noise before and after the video 
signal representing the picture information; and 

Fig. 21 is a block diagram of a sensing device for sensing 
and removing the noise which^ in the preferred embodiment, is in 
the form of a blanking circuit . 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

Before commencing with the detailed description of the 
preferred and other embodiments of the present invention, the 
following review will provide a better understanding of the 
application and utility of the present invention to optical 
instruments or optical devices which are used to produce an 
optical image directed onto or imaged onto a video sensor or 
camera . 
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Video camer-as used with optical inst^ruments for medical and 
industrial applications generally are known as an "'analog video 
camera" , a ""digital video camera" or a ""digitally controlled 
video camera''' . 

In an analog video camera, the video sensor is typically 
separated from a video signal processor which is sometimes 
referred to as the video camera. The output of a CCD is an 
analog signal which is applied to a preamplifier. The output of 
the preamplifier is operatively connected to a remotely disposed 
video signal processor either directly by electrical conductors 
or indirectly by a wireless device such as infrared transmitter 
and receiver. The output of the video signal processor is an 
analog video signal in a preselected format, e.g., NTSC, Y/C, RGB 
or other Format. All signal transmission and processing is 
accomplished using analog techniques. 

In a digital video camera, the video sensor is again 
typically separated from the video signal processor. The output 
of a CCD is an analog signal which is applied to a preamplifier. 
The output of the preamplifier is operatively connected by a 
analog- to-digital converter to a remotely disposed digital signal 
processor. The output of the digital signal processor is applied 
to a digital-to-analog converter wherein the output thereof is an 
analog video signal in a preselected format, e.g., NTSC, Y/C, RGB 
or other Format. It is also envisioned that the preselected 
format, encoding scheme or standard television system encoding 
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format could be the PAL format, SECAM format or any other format 
utilized in a country as a standard of that country. In 
addition, the format could be a proprietary format for use in a 
closed circuit television system. The use of the term ^^NTSC, 
Y/C, RGB or other Format'' is intended to all cover of such 
preselected formats of output video signals. 

In a digitally controlled video camera, the video sensor 
preamplifier and remotely disposed video signal processor are 
substantially operationally the same as the analog video camera. 
However, a digital system controls the operation of each of the 
components and controls transfer of signals between components, 
all under control of a digitally programmed devices. However, 
the output of the video camera is an analog video signal in a 
preselected format, e.g., NTSC, Y/C, RGB or other Format. 

The video signal compensator, apparatus and method of the 
present invention can be used with any of the above described 
video cameras. The term ^'video sensor" as used herein is 
intended to collectively and broadly refer to a video sensor, 
line sensor, solid state sensors, area sensors, CAD, vidicon 
tubes, CCD sensors or other video sensors used in practicing this 
invention including sensors located at the proximal end of the 
optical instrument, such as an endoscope. Also, the term ^^video 
sensor" is intended to cover all such sensors located at a 
different location in the optical instrument, such as at a CCD 
sensor located the distal tip of an endoscope, or to a video 
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camera opeiratively attached to an optical installment, endoscope 
03r other optical device wherein an optical image developed by the 
optical instrument or optical device, having an illumination 
provided from a light source or a light guide, is imaged onto a 
CCD sensor or video camera * 

Referring now to Fig. 1, Fig. 1 illustrates the preferred 
application for using the teachings of the present invention in 
an endoscope. Fig. 1 illustrates an instrument, generally as 30, 
which is an endoscope in the form of a laparoscope for medical 
surgery. The instrument 3 0 includes a rigid elongated sheath 
tube 32 having a selected length and a distal section or end 3 6 
and a proximal section or end 38. The distal end 3 6 terminates 
in a distal tip shown generally as 44 . The interior of the 
laparoscope includes an optical image transferring means, system 
or member, typically a lens system including relay lenses, for 
transferring an optical image from the distal tip 44 through the 
ridged elongated sheath tube 32 to the proximal end 38 of the 
laparoscope . 

The proximal end 3 8 of the laparoscope is operatively 
connected to an extension member shown generally as 48 . The 
extension member 48 includes means for supporting a light post 52 
and means for defining openings or ports for two channels, which 
openings are shown as 54 and 6 0 (60 being visible in Fig. 2) . 
Valve means, which in the preferred embodiment are trumpet valves 
58 and 62, are operatively connected to openings 54 and 60 
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^respectively , An eyepiece housing, shown gener-ally as 64, 
terminates in an eyepiece 66 which permits a surgeon to view the 
optical image transferred through the laparoscope. However, in 
Fig. 1, a video sensor, typically a CCD sensor and preamplifier, 
shown generally as 68^ is operatively connected to the eyepiece 
to convert the optical image into a video signal . The video 
signal is ultimately processed t>y a video signal processing 
means, for example 134 in Fig. (8) , to produce a video image on a 
monitor or video signals for storage of the video image on 
magnetic tape or other storage means. 

The laparoscope 3 0 may include a plurality of channels which 
can be used for a number of functions. Several species or 
embodiments of laparoscopes are disclosed herein in Figs . 1 
through 7 to show that the present invention can be used with a 
wide variety of endoscopes or optical instruments. 

Fig, 2 shows the proximal end of another embodiment of a 
laparoscope 3 0 having a video sensor housing, shown generally as 
64', which is adapted to have a video sensor 68' directly 
operatively attached thereto for practicing this invention. In 
addition. Fig. 2 illustrates pictorially that a light source 67 
is operatively coupled to the light post 52. The light post 52 
is operatively connected to a fiber optic light guide shown as 72 
in Fig. 4. The fiber optic light guide transmits the light 
energy from the light post 52 located at the proximal end 3 8 of 
the laparoscope 30, through the rigid elongated sheath tube 3 2 to 
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the distal section arr end 36. The light energy is then is 
directed onto the operative site or inspection area to illuminate 
the same . 

Typically the light sources are metal halide, xenon light 
sources or other similar devices. The light energy from the 
light source 67 is in the form of a light beam or radiation beam 
that has defined spatial distribution characteristics which 
generally includes that center thereof has higher brightness than 
the periphery or edges thereof. The light energy is applied to 
the fiber optic light guide, or light guide in other optical 
instruments, through a light post or equivalent device such as a 
coupling lens or cone system. 

The fiber optic light guide, as well as the other light 
guides, transmits the light energy and retains the defined 
spatial distribution characteristics of the light energy. The 
light energy is directed onto the operative site or inspection 
area to illuminate the same . The reflected light returned from 
the cosine angle of the reflecting surface is transmitted by the 
optical image transferring system to the proximal end of the 
optical instrument 3 0 where the optical image having the 
differential picture brightness developed by the spatial 
distribution characteristics of the light energy, is imaged on 
the video sensor 68'. In the alternative, the optical image can 
be sampled or sensed, using digital sampling and measuring 
techniques which are well known in the art, and a correction or 
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compensating signal based thereon can be developed and applied to 
video amplifiers to reduce the gain in the bright areas and 
increase the gain in the dark areas to produce a video signal 
representing an optical image having substantially even field 
illumination , 

In Fig, 2, the fiber optic light guide used for illumination 
of the operative site or inspection area can be varied in 
structure as illustrated in the embodiments of Figs, 4 through 7 
as described herein below. However, the non-uniform 
characteristics of a light source 67 is are transmitted through 
the light guide in the optical instrument to the distal end and 
illuminates the operative site or inspection area which produces 
the optical image having a differential picture brightness due to 
uneven illumination . 

Fig. 3 shows another embodiment of a distal end of a 
laparoscope utilizing the teachings of the present invention. In 
the embodiment of Fig. 3, the distal tip 44 includes means which 
are located within the rigid elongated sheath tube 32 for 
defining at the distal end 3 6 a means for directing a fluid flow 
across the exterior surface of an image passing means shown 
generally as 76. Image passing means 76 including the distal end 
of the optical image transferring system of member is located in 
the center of an aperture 74. In Fig, 3, the image passing means 
may be a distal lens, a window or transparent surface for a CCD 
sensor, or video sensor or the like. In Fig. 3, the means for 
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directing fluid flow across the exterior surface is shown 
generally as nozzle 80. The nozzle 80 is located in the space 
shown as 70 which houses a fiber optic light guide means which is 
shown in great detail in Figs, 4 through 7. 

Fig. 4 shows yet another emiDodiment of a laparoscope having 
a nozzle and irrigation channel. Specifically, the distal end 44 
of the laparoscope includes a transparent memlDer 76 which is 
located in the aperture opening 74. In Fig. 4, the nozzle 8 0 
which is located in space 70, directs a fluid flow across the 
exterior surface of the transparent member 7 6 and second channel 
86 functions as an irrigation orifice. Of course-, such a nozzle 
is not required to practice this invention, but keeping the 
transparent member clear of image impeding material substantially 
improves the quality of the optical image passed by the 
endoscope . 

The light fibers forming the fiber optic light guide 72 are 
located around the optical image transferring system or member 
and are positioned around the various orifices and nozzles as 
depicted in Fig. 4. 

Fig. 5 illustrates the structure of a distal end of a 
laparoscope similar to the illustrated in Fig. 4 with the 
addition of a third channel 90 which can be used for other uses 
during surgery, such as for example as an aspiration orifice. 

Fig. 6 illustrates the structure of yet another distal end 
of a laparoscope similar to the illustrated in Fig. 5 with the 
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addit Ion of a fouDTth ctiannel 92 . Ch.a.nnels 86, 90 a.nd 92 aire 
equally space around the optical image trans ferr-ing system or 
optical image transferring member. As in Fig. 4, the light 
fibers forming the fiber optic light guide 72 are located around 
the optical image transferring system or member and are 
positioned around the various orifices and nozzles. 

Fig. 7 illustrates yet another embodiment of a laparoscope 
wherein the distal end 44 has a different structure than the 
structures of Fig, 3 through 6. One difference is that the 
transparent member 76 is of center relative to the elongated 
sheath tube 32. As such, the aperture opening 74 is off center 
relative to the elongated axis 102, but is coaxial with the 
central axis 100 of the transparent member 76. As a result of 
the offset of the axis 100 and 102, an expanded space shown 
generally as 110 is provided between the rigid elongated sheath 
tube 3 2 and the optical image transferring member located within 
the laparoscope. A working channel 96 is provided in the 
expanded space 110. The light fibers foirming the fiber optic 
light guide 72 are located around the optical image transferring 
member and are positioned around the various orifices, nozzles 
and working channels . 

In each of the structures of the distal ends of endoscopes 
illustrated by Figs. 2 through 7, the fiber optic light guide 72 
directs the light energy out of the distal end and, in each 
embodiment, the light energy retains the non-uniform or 



-30- 



255 012797 7256 613X00/1580 

unevenness in illumination of the light source, e.g., light 
source 6 7 as shown in Fig. 2. Of importance, the compensating 
apparatus or video signal compensator are operative with any of 
the optical images developed by the endoscopes illustrated in 
Figs. 1 through 7 to produce a video signal representing an 
optical image having substantially uniform brightness due to 
uneven illumination . 

In the alternative, the fiber optic light guide 72 could be 
eliminated and electrical conductors could be e:>ctended through 
the endoscope to the light bulb or light source located at the 
distal end. The light bulb or light source could be located in 
the position shown by working channel 96 in Fig, 7. 

Fig. 8 illustrates a preferred embodiment of a compensating 
apparatus for practicing this invention. An optical image having 
differential picture brightness due to uneven or non-uniform 
illumination (the term ^^uneven illumination'' being use to 
describe this characteristic) developed from an optical 
instrument having a light guide operatively coupled to a light 
source is illustrated by arrow 118 . The optical image having 
differential picture brightness due to uneven illumination 118 is 
imaged directly onto a video sensor 120. The output from the 
video sensor is an analog video signal which is applied to a 
preamplifier 122. 

The video sensor 120 and preamplifier 122 are generally 
located with or operatively attached to the optical instrument as 
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described in connection witln Figs. 1 and 2. In such, event, 
electrical conductors 124, which are operatively connected to the 
preamplifier 122, extend from the proximal end of a laparoscope 
to a remotely disposed video signal processing apparatus depicted 
by dashed box 128. The video signal processing apparatus 128 
includes a video signal compensator or compensating apparatus 
130 , 

The video signal compensator or compensating apparatus 13 0 
performs the function of generating a compensating signal which 
is used to compensate the video signal representing the optical 
image having differential picture brightness due to uneven 
illumination 118 . The compensating signal of the video signal 
compensator or compensating apparatus 130, shown as output 132, 
is applied as an input to a standard analog video signal 
processor 134 which processes video signals to produce an analog 
video in a preselected format, e.g., NTSC, Y/C , RGB or other 
Format . 

When the compensating signal on output 13 2 is added to the 
input of the video signal processor 134, the output from the 
video signal processor 134, appearing on output 136, is a video 
signal compensated to represent the optical image having 
substantially uniform brightness. The compensated video output 
signal on output 13 6 is applied to a monitor, video storage 
device, printer or other video device depicted by box 13 8. 
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As shown in Figu^re 8, the video signal compensator 130 is 
located between the preamplifier 122 and the video signal 
processor 134. The advantages of locating the video signal 
compensator 13 0 in this position is that the video signal is in 
analog format as it is generated by the CCD sensor. The 
preamplifier generally performs the function of providing 
sufficient amplification of the analog video signal to drive the 
electrical conductors with the analog video signal to deliver an 
amplified video signal to the remote video signal processor. 
Another advantage is that the preamplifier video signal and 
compensating signal can be added at the front end to the video 
signal processor .such that the video signal processor process a 
compensated video signal. 

However, it is also possible to add the compensating signal 
to the video signal after processing of the video signal. For 
example. Fig. 9 illustrates a typical digital video camera. In 
Fig. 9, the optical image having differential picture brightness 
due to uneven illumination 118 is imaged directly onto a video 
sensor 120. The output from the video sensor is an analog video 
signal which is applied to a preamplifier 122 as described above 
relative to Fig. 8. 

The amplified video signal appearing on output 12 6 is 
applied to an analog- to-digital converter 142, the output of 
which is a digitized video signal representing the optical image 
having differential picture brightness due to uneven 
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illumination. The output of the analog- to-digital converter 142 
is applied to a digital signal processor 146 where the output 
signal is a processed analog video signal representing the 
optical image having differential picture brightness due to 
uneven illumination. The output of the digital signal processor 
146 is applied to a digital-to-analog converter 150, the output 
of which is an analog signal in a standard or preselected format, 
such as an NTSC, Y/C, RGB or other Format video signal. A video 
signal compensator 154, utilizing the teachings of this 
invention, then produces a compensating signal in the preselected 
format which is added to and compensates the video signal to 
represent an optical image having substantially uniform 
illumination. The compensated output signal appearing on output 
156 is applied to a monitor, video storage device, printer or 
other video device depicted by box 158 . 

The compensating waveform may also be added to the analog or 
digital signal processor. Figs. 10 and 11 discussed below are 
exemplary . 

In Fig. 10, the compensating signal is added to the video 
signal before digital processing of the video signal. For 
example. Fig. 10 illustrates a digital video camera wherein the 
optical image having differential picture brightness due to 
uneven illumination ' 118 is imaged directly onto a video sensor 
120. The output from the video sensor is an analog video signal 
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which is applied to a preamplifier 122 as described above 
relative to Fig. 8 . 

The amplified video signal from the preamplifier 122 is 
applied to an analog- to-digital converter 160, the output of 
which is a compensated analog video signal representing the 
optical image having differential picture brightness due to 
uneven illumination. The output of the video signal compensator 
160 is applied to an analog- to-digital converter 161 wherein the 
digital signal is applied to a digital signal processor 162 . The 
output of the digital signal processor 162 is a digitized 
compensated video signal which is applied to a digital-to-analog 
converter 163 wherein the output signal from the digital-to- 
analog converter 163 is a processed analog video signal 
representing the optical image having differential picture 
brightness due to uneven illumination. The output of the 
digital - to- analog converter 163 is applied to a monitor, video 
storage device, printer or other video device depicted by bo>:: 
164 . 

Fig. 11 illustrates another embodiment of a typical analog 
video camera having a video signal compensator located after the 
analog video signal processor. In Fig. 11, the optical image 118 
having differential picture brightness due to uneven illumination 
lis is imaged directly onto a video sensor 12 0. The output from 
the video sensor 120 is an analog video signal which is applied 
to a preamplifier 122 as described above relative to Fig. 8. 
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The amplified video sigrial from the preamplifier 122 is 
applied to an analog video signal processor 165. The output from 
the analog video signal processor 165 is applied to a video 
signal compensator 166 where the output signal is a processed 
analog video signal representing the optical image having 
differential picture brightness due to uneven illumination. The 
output of the video signal compensator 166 is in a standard or 
preselected format, such as an NTSC, Y/C, RGB or other Format 
video signal. The video signal compensator 166, utilizing the 
teachings of this invention, produces a compensating signal in 
the preselected format which is added to and compensates the 
video signal to represent an optical image having substantially 
uniform illumination. The compensated output signal from the 
video signal compensator 166 is applied to a monitor, video 
storage device, printer or other video device depicted by box 
168. It is envisioned that the video signal compensator could be 
used at numerous locations in the video signal circuit path, or 
even in the digital signal processor. 

Figure 12 (a) is a graph of the video signal depicted by 
waveform 162 representing the optical image having differential 
picture brightness due to uneven illumination. The reference 
line for brightness is shown as 170 . The portion shown as 172 of 
the waveform 170 represents that part of the optical image 118 
which is less bright than a reference 170 and the portion shown 
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as 174 shows that part of the optical image which, at its peak, 
is br-ighter than the reference 170. 

Figure 12 (b) is a graph of the compensated video signal 
depicted by waveform 178 representing the optical image after the 
gain of the video signal has been compensated by the compensating 
signal generated by the video signal compensator 13 0 of Fig. 8. 
The reference line for brightness is shown as 170. The portion 
shown as 180 of the waveform 178 represents that part of the 
optical image 118 which was less bright than a reference 170 
output video signal and its gain both ver-tically and horizontally 
was compensated by increasing the gain of the video signal 
representing that part of the optical image which was less bright 
than the reference 170 , 

With respect to the portion of the compensated video signal 
shown as 182 which was brighter than the reference 170, its gain 
was compensated both horizontally and vertically by reducing the 
gain of the video signal compensating the video signal to 
represent an image having a substantially uniform brightness. 

Fig. 13 (a) pictorially represent an optical image wherein 
the differential picture brightness of an optical image is 
brighter at its center 188 than at its periphery 190. The solid 
portion of lines 192 depict a decreasing brightness of the 
optical image while the dashed portions of line 192 depict the 
less brightness as the brightness of the optical image drops of 
to the periphery 192 which is less bright. 
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Fig, 13(b) pictorially represent an optical image wherein 
the differential picture brightness of an optical image is 
brighter at its periphery 196 than at its center 188 . The solid 
portion of lines 200 depict a decreasing brightness of the 
optical image while the dashed portions of line 2 00 depict the 
less brightness as the brightness of the optical image is less 
bright at the center 19 8. 

Fig, 14 is a pictorial representation of a line 2 04 
representing the top portion of an envelope of a compensated 
video signal plotting the intensity as a function of distance ""S" 
from the axis of the image 206. As shown by the line 204, the 
compensated video signal is amplified by a controlled device such 
as a controlled gain amplifier or variable gain amplifier to 
increase the brightness of the output video signal to a level 
which is greater than the average of the differential brightness 
of the optical image due to the uneven illumination. 

Before describing the operation of the schematic diagram of 
Fig. 16 which is of the embodiment of the video signal 
compensator 134 illustrated in Fig. 8, the following discussion 
relates to the form of the basic waveforms that are used in the 
video signal compensator for compensating differential picture 
brightness of an optical image due to uneven illumination. 

The video signal compensator comprises a device for 
generating a compensating signal substantially representing at 
least one parameter of a compensating waveform required for the 
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differential picture brightness of an optical image to produce a 
video signal representing an optical image having a substantially- 
uniform brightness. In the schematic diagram of Fig. 16, the 
video signal compensator is an analog signal generating device . 

The video signal compensator includes a sawtooth wave 
generator for generating a. sawtooth waveform having a 
predetermined rising slope and a sawtooth wave generator for 
generating a sawtooth waveform having a predetermined falling 
slope . 

Fig. 15(a) is a sawtooth waveform 210 having a predetermined 
rising slope and a controlled amplitude. Fig. 15(b) is a 
sawtooth waveform 212 having a predetermined falling slope and a 
controlled amplitude . 

The video signal compensator also includes a parabolic wave 
generator for generating a parabolic waveform having a controlled 
amplitude and orientation. 

Fig, 15 (c) is a parabolic waveform 214 having a controlled 
amplitude and orientation. If the orientation of the parabolic 
waveform is reversed, it is referred to as an "'inverted parabolic 
waveform . " 

The amplitude and slope of the sawtooth waveform and the 
amplitude and the orientation of the parabolic v/aveform are 
adjusted as required to generate an acceptable compensating 
signal. In operation, an analog signal adder operatively coupled 
to the sawtooth wave generator and the parabolic wave generator 
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adds the sawtooth wavefoirms and the parabolic wavefoirm to produce 
a compensating signal. The compensating signal is used to 
compensate the video signal representing the optical image having 
differential picture brightness due to uneven illumination. 

Referring now to the schematic diagram of Fig. 16, the 
circuit is based on the use of two (2) quad operating amplifiers. 
In operation, the horizontal synchronizing signals of the 
composite video signal are applied to lead 220 and inverted by 
amplifier 224 . If the horizontal synchronizing signals of the 
composite video signal are of proper polarity, then inversion of 
the signals will not be necessary. The output of amplifier 224 
is applied as an input to amplifier 226 which is used as the 
sawtooth wave generator to generate a sawtooth waveform in the 
form of sawtooth waveform 210 of Fig. 15(a) having a 
predetermined rising slope and a controlled amplitude. The 
output of the sawtooth wave generator 226 applies the sawtooth 
waveform to lead 23 0 which forms one side of a sawtooth waveform 
balance network 23 6. The output of the balance network 23 6 is 
adjusted as reqxiired to produce an acceptable balance using the 
sawtooth waveform by the variable pot, variable resistor or 
potentiometer depicted as balance network 136. The output from 
balance network 136 appears on lead 252, 

In addition, the output of the sawtooth wave generator 22 6 
applies the sawtooth waveform to lead 24 0 which is an input to 
amplifier 244. Amplifier 244, which essentially functions as a 
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sawtooth wave invert ex, inverts the sawtooth waveform having a 
predetermined rising slope and a controlled amplitude to generate 
a sawtooth waveform having a predetermined falling slope and 
controlled amplitude in the form of sawtooth waveform 212 of Fig. 
15(b) . The output of the amplifier 244, applies the sawtooth 
waveform to lead 250 which forms the other side of a sawtooth 
waveform balance network 23 6, 

The output of the amplifier 244 is applied to input 254 of 
an amplifier 25 6 which functions as a parabolic wave generator. 
Amplifier 256^ produces as an output a parabolic waveform having 
a controlled amplitude and orientation in the form of parabolic 
waveform 214 of Fig, 15(c) having a controlled amplitude and 
orientation. In the preferred embodiment, the parabolic waveform 
is an inverted parabolic waveform. 

Lead 252, which is the output of the balance network 13 6 is 
operatively connected to a summation terminal 26 0 which is an 
analog adder. The balance or mix of the sawtooth waveforms 
received by inputs 230 and 250, respectively, are controlled by 
the adjustment of the balance network 236. In addition, the 
output of the amplifier 256, which functions as a parabolic 
waveform generator, applies the parabolic waveform having a 
controlled amplitude and orientation to the summation terminal 
260, to produce the horizontal component of the compensating 
signal . 
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The vertical portion of the compensating signal is generated 
as follows. The vertical synchronizing signals of the composite 
video signal is applied to lead 270 and inverted by amplifier 
272 . If the vertical synchronizing signals of the composite 
video signal are of proper polarity, then inversion of the 
signals will not be necessary. The output of Amplifier 272 is an 
input to amplifier 274 which issued as the sawtooth wave 
generator to generate a sawtooth waveform in the form of sawtooth 
waveform 210 of Fig. 15(a). The output of the sawtooth wave 
generator 2 74 applies the sawtooth waveform to lead 2 80 which 
forms one side of a sawtooth waveform balance network 286. The 
output of the balance network 302 is similarly adjusted by the 
variable pot, variable resistor or potentiometer depicted as 
balance network 286 and the output appears on lead 302. 

In addition, the output of the sawtooth wave generator 274 
applies the sawtooth waveform to lead input 290 of an amplifier 
294. Amplifier 294, which essentially functions as a sawtooth 
wave inverter, inverts the sawtooth waveform having a 
predetermined rising slope and a controlled amplitude to generate 
a sawtooth waveform having of Fig. 15(b) . The output of the 
amplifier 2 94, which also functions as a sawtooth wave inverter, 
applies the sawtooth waveform to lead 3 00 which forms the other 
side of a sawtooth waveform balance network 286. 

The output of the amplifier 294 is applied to input 304 of 
an amplifier 3 06 which functions as a parabolic wave generator. 
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Amplifier 3 06, produces as an output a parabolic waveform having 
a controlled amplitude and orientation in the form of parabolic 
waveform 214 of Fig. 15(c). In the preferred embodiment, the 
parabolic waveform is an "inverted parabolic waveform." 

Lead 3 02 of the output of the balance network 286 is 
operatively connected to a summation terminal 310 which is an 
analog adder. The balance or mix of the sawtooth waveform 
received by inputs 280 and 3 00, respectively, are controlled by 
the adjustment of the balance network 286. In addition, the 
output of the amplifier 306, which functions as a parabolic 
^ waveform generator, applies the parabolic waveform having a 

„ controlled amplitude and orientation to the summation terminal 

O 

^ 310, or analog adder, to produce the vertical component of the 

01 compensating signal. 

The horizontal portion of the compensating signal appearing 
on the summation terminal 2 60 and the vertical portion of the 
compensating signal appearing on the summation terminal 260 are 
applied to summation terminal 316 which produces the compensating 
signal required to compensate the video signal to represent the 
optical image having substantially uniform brightness. The 
compensating signal appearing on summation terminal 316 is 
s-pplied as an input to controlled gain amplifier 33 0 which 
amplifies the compensating signal to the desire level. 

Amplifier 340 is unused. The output of the controlled gain 
amplifier 33 0 has a high impedance relative to the video signal 
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to be compensated in tiie video signal processor-, illustrated as 
134 in Fig. 8. Therefore, the output of the amplifier 330 is 
applied to input 332 of a video driver 334 which produces a 
compensating signal on output 33 6 at a low impedance. Output 33 6 
is then applied to the preamplifier stage of the video signal 
processor 134 of Fig. 8 as is well known to a person skilled in 
the art . An adder in the video signal processor 134 is used to 
add the compensating signal and video signal to produce the 
compensated video signal. 

Based on the above • description, it is readily apparent that 
the video signal compensator is a device for generating a 
compensating signal substantially representing at least one 
parameter of a compensating waveform required for the 
differential picture brightness of an optical image to produce a 
compensating signal. For example, the parabolic waveform would 
be used alone if one of a sawtooth wave generator and a parabolic 
wave generator was used to practice the teachings of this 
invention, a compensating signal would be generated which 
compensates the video signal to represent at least an improved 
optical image having substantially uniform brightness. In the 
preferred embodiment, both the sawtooth waveforms and the 
parabolic waveform are used produce the compensating signal used 
to compensate an uncompensated analog video signal to represent 
an optical image having substantially unifozrm brightness. 
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As described above, the compensating signal is added to the 
video signal at the input of a video signal processor 134 to 
produce a compensating video signal. The video signal process is 
responsive to the compensating signal by adjusting the gain both 
vertically and horizontally by increasing the gain of the video 
signal representing that part of the optical image which is less 
bright than a reference and reducing the gain of the video signal 
representing that part of the optical image which is brighter 
than a reference compensating the video signal to represent an 
image having a substantially uniform brightness. 

In the preferred embodiment, the differential picture 
brightness is brighter at- its center than at its periphery. The 
video signal compensator adder adds the sawtooth waveform, the 
parabolic waveform and the video signal to produce a compensating 
signal which is applied as an input to a video signal processor 
adjusting its gain both vertically and horizontally. This is 
accomplished by increasing the gain of the video signal in 
response the sawtooth waveform representing the periphery of the 
optical image and by reducing the gain of the video signal in 
response to the parabolic waveform representing the center of the 
optical image resulting in the video signal representing an 
optical image having a substantially flat brightness. 

In the event that the differential picture brightness of an 
optical image is brighter at its periphery than at its center. 
The adder adds the sawtooth waveform, the parabolic waveform and 
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the video signal to piroduce a compensating signal which is 
applied as an input to a video signal processor together with a 
compensating signal producing a compensated video signal , The 
compensated video signal is used to adjust the gain of the video 
signal processor both vertically and horizontally. This is 
accomplished by decreasing the gain of the video signal in 
response the sawtooth waveform representing the periphery of the 
optical image and by increasing the gain of the video signal in 
response to the parabolic v/aveform representing the center of the 
optical image resulting in said video signal representing an 
optical image having a substantially flat brightness. 

Figures 1 through 16 disclose the elements or components of 
a preferred embodiment of a system for practicing -chis invention. 
The system includes an endoscope 3 0 having a proximal end 3 8 and 
a distal end 36. A light guide 72 is located within the 
endoscope and extends from the proximal end 3 8 to the distal end 
36 of the endoscope 30. The light guide 72 has a light post 52 
at its proximal end which is adapted to receive light energy from 
a light source 67 and to transmit the light energy from its 
distal end to illuminate an operative site. 

In the alternative, the light guide 72 could be eliminated 
and an illumination source such as a light bulb could be located 
di rectly at the distal end 3 6 of the endoscope 30. 

The endoscope includes an optical image transferring member, 
included as part of element 76, which extends from the proximal 



-46- 



255 012797 7256 6X3100/1580 

end 3 8 to the distal end 3 6 of the endoscope. A light sour-ce 67 
is operatively connected to the light post 52 to apply light 
energy to the light guide 72. A video sensor* 68 is operatively 
coupled to the proximal end of the endoscope 3 0 for imaging an 
optical image having differential picture brightness due to 
uneven illumination . 

A compensating apparatus is operatively coupled to the video 
sensor and includes a sawtooth wave generator for generating a 
sawtooth waveform having a predetermined rising slope ^ a 
predetermined falling slope and a controlled amplitude. In 
addition, the compensating apparatus includes a parabola wave 
generator for generating a parabola waveform having a controlled 
amplitude and orientation. An adder is operatively coupled to 
the sawtooth wave generator, the parabolic wave generator and a 
video signal for adding the sawtooth waveform and the parabolic 
waveform to produce a compensating signal which is used as an 
input to a video signal processor adjusting its gain both 
vertically and horizontally. This is accomplished by increasing 
the gain of the video signal representing that part of the 
optical image which is less bright than a reference and reducing 
the gain of the video signal representing that part of the 
optical image which is brighter than a reference compensating the 
video signal to represent an image having a substantially uniform 
brightness , 
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Also, the pr-efer-red embodiment of the endoscope includes a 
light guide 72 which is a fiber optic light guide and the 
laparoscope having a fiber optic light guide independent of the 
distal end of the endoscope produces and optical image having a 
differential picture brightness which is brighter at its center 
than at its edges , 

In the embodiment of Fig. 17, an optical image having 
differential picture brightness due to uneven illumination 398 is 
imaged directly onto a CCD sensor 400, The output from the video 
sensor 400 is an analog video signal which is applied to a 
preamplifier 402, The preamplified video signal is applied to an 
analog-to-digital converter 406. The video signal compensator in^ 
this embodiment is a part of a digital signal processing device 
shown by dashed lines 410 . 

The digital signal processing device 410 includes a digital 
storage device or freeze frame 414 for storing a digital 
representation of the video signal having the differential 
brightness due to uneven illumination received from the analog- 
to-digital converter 406. Concurrently, the digital video signal 
from the analog- to-digital converter 406 is applied to a digital 
signal processor 416 for digitally processing the digital 
representation of the video signal. The digital processor 416 
produces a digital compensating signal representing at least one 
parameter of a compensating waveform reqiaired for the 
differential picture brightness of an optical image to produce a 
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video signal repiresenting an optical image having a substantially 
uniform brightness. The digital processor 416 digitally 
calculates the components of the compensating signal using a 
sawtooth waveform reference and a parabolic waveform reference in 
a process analogous to that of the analog process described above 
for the analog processing, except however, the calculation is 
performed digitally. The output form the digital signal 
processor 416 is a compensating signal in analog format having an 
illumination signal and color signal . Illuminates signal Y^, 
appears on lead 424 and color signal to appears on lead 426. 

The video signal is stored in the digital storage device 414 
for a predetermined period of time and is applied to a digital- 
to-analog converter 420. The output from the digital-to-analog 
converter 420 is the analog video signal representing the output 
image 390 delay by a predetermined time period. The output from 
the digital-to-analog converter 420 appears on output 430* 

The illumination signal Y^ on lead 424 is applied as an 
input to first adder 434. The color signal on lead 426 is 
applied as an input to a second adder 438. The delayed 
uncompensated analog video signal on output 43 0 is applied to 
each of the first inputs of the adders 434 and second adder 438. 

The analog output from the first adder 434 is in the form of 
a compensated illumination signal Y^ which appears on output lead 
44 0. The analog output from the second adder 43 8 is in the form 
of a compensated color signal which appears on output lead 
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442 . The output: video signal repiresents the optical image having 
substantially unifoirm brightness and is applied to a device shown 
by 138 in Fig, 8. 

In the embodiment of Fig. 18, the initial components are the 
same as described in Fig, 17 and include the optical image having 
differential picture brightness due to uneven illumination 398 
being imaged directly onto a CCD sensor 400. The output from the 
video sensor 400 is an analog video signal which is applied to a 
preamplifier 402, The preamplified video signal is applied to an 
analog-to-digital converter 406. The video signal compensator in 
this embodiment is a part of a digital signal processing device 
shown by dashed lines 410. 

At this point, the embodiment of Fig. 18 differs from that 
of Fig. 17. In the embodiment of Fig. 18, the digital signal 
processing device 410 includes a digital storage device or freeze 
frame 414 for storing a digital representation of the video 
signal having the differential brightness due to uneven 
illumination received from the analog- to-digital converter 406 . 
Concurrently, the digital video signal from the analog- to-digital 
converter 4 06 is applied to a programmable digital processor 
shown by dashed box 410' for digitally processing a digital 
representation of the video signal representing the differential 
picture brightness of the optical image due to uneven 
illumination. The digital signal processor 410' produces a 
digital compensating signal representing at least one parameter 



-50- 



255 012797 7256 613100/1580 

of a compensating wavefoxm r-equinred foir th.e dif f eirent ial pictur-e 
brightness of an optical image to produce a video signal 
representing an optical image having a substantially uniform 
brightness. In this embodiment the programmable digital 
processor 410' includes an 8 x 8 pixel matrix 
multiplexer/processor 450, 

The video signal is stored in the digital storage device 414 
for a predetermined period of time to enable the 8X8 pixel 
matrix multiplexer/processor 450 to digitally calculate the 
components of the compensating signal using a sawtooth waveform 
reference and a parabolic waveform reference in a process 
analogous to that of the analog process described above for the 
analog processing, except however, the calculation is performed 
digitally. The 8x8 pixel matrix multiplexer/processor 450 
analyzes the brightness level of the optical image represented by 
the video signal on a bit -by-bit bases against a brightness 
reference to determine the required compensating signal for the 
horizontal and vertical components thereof. The output of the 8 
X 8 pixel matrix multiplexer/processor is a digital signal . 

The output from the digital storage device 414 is applied to 
the 8x8 pixel matrix multiplexer/processor 450 where the 
digital video signal is compensated with the compensating signal 
generated by the 8x8 pixel matrix multiplexer/processor 450. 
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The output from the 8x8 pixel matrix multiplexer/processor 
450 is applied to the digital signal processor 416 which produces 
a compensated analog video signal representing the differential 
picture brightness substantially uniform brightness. The digital 
techniqries for performing this analysis are well known to persons 
skilled in the art . 

In the embodiment illustrated in Fig, 18, the analog output 
from the digital signal processor 416 is in the form of a 
compensated illumination signal which appears on output lead 
452 and a color signal Cj^ which appears on output lead 4 54 . 

In smaller diameter endoscopes having a diameter at the 
distal end in the order of about 5 mm or less, the video signal 
representing the optical image typically has a waveform 46 0 
illustrated by Fig, 19. In Fig. 19, the waveform 460 has a low 
level noise portion of the video signal shown as element 4 62 
which appears before the video information signal portion 4 64 ot 
the video signal and a low level noise portion of the video 
signal shown as element 466 which appears after the video signal 
portion 464 representing the picture information. This low level 
noise portion of the video signal 460 can be monitored by a 
sensing device for sensing and removing the noise to improve the 
video signal . 

Fig. 20 illustrates a waveform 470 of the video signal from 
a small diameter endoscope illustrating the effects of the 
sensing device for sensing and removing the noise before and 
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after- the video signal. In Fig. 20, the portion of the signal 
shown as 472 before the information portion of the signal 474 has 
the noise removed therefrom. The picture portion of the video 
signal 474 is substantially the same as the information signal 
portion 464 of Fig. 19. Also, in Fig. 20, the portion of the 
signal shown as 476 after the information portion of the signal 
4 74 has the noise removed therefrom. In this manner, the picture 
information represented by the portion of the signal 4 74 
represents the definitive picture signal. 

In the preferred embodiment, the sensing device for sensing 
and removing the noise is in the form of a blanking circuit 480 
as illustrated by Fig. 21, The signal appearing on input 482 to 
the blanking circuit 480 is essentially in the form of the 
waveform 460 shown in Fig. 19. The signal appearing on the 
output 4 84 of the blanking circuit is essentially in the form of 
the waveform 470 shown in Fig. 19. One example of a sensing 
device that can be used in such a blanking circuit is a Schmidt 
trigger which reqfuire that a certain threshold voltage level be 
reached by the video signal before the amplifier receives the 
input video signal. Of course, any known electrical system or 
circuit for sensing and removing the noise is envisioned to be 
within the teachings of this invention. 

The present invention includes a method for compensating for 
differential picture brightness of an optical image due to uneven 
illumination. The method comprises the steps of: (a) generating 
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with a compensating- signal generating device a compensating 
signal substantially representing at least one parameter of a 
compensating waveform required for the differential picture 
brightness of an optical image to produce a video signal 
representing an optical image having a substantially uniform 
brightness; and (b) adding with an adder operatively coupled to 
the compensating signal generating device and a video signal the 
compensating video signal and the video signal to produce a 
compensating signal which .is used as an input to a video signal 
processor to adjust its gain both vertically and horizontally by 
increasing the gain of the video signal representing that part of 
the optical image which is less bright than a reference and 
reducing the gain of the video signal representing that part of 
the optical image which is brighter than a reference compensating 
said video signal to represent an optical image having a 
substantially uniform brightness. 

In an application where the differential picture brightness 
of an optical image is brighter at its center than at its edges, 
the method step of adding produces as an output signal a video 
signal having its gain both vertically and horizontally 
compensated by increasing the gain of the video signal in 
response the sawtooth waveform, representing the edges of the 
optical image and reducing the gain of the video signal in 
response to the parabolic waveform representing the center of the 
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optical image compensating said video signal to represent an 
optical image having a substantially flat brightness . 

In an application where the differential picture brightness 
of an optical image is brighter at its edges than at its center, 
the method step of adding produces as an output signal a video 
signal having its gain both vertically and horizontally 
compensated by decreasing the gain of the video signal in 
response the sawtooth waveform representing the edges of the 
optical image and increasing the gain of the video signal in 
response to the parabolic waveform representing the edges of the 
optical image resulting in said video signal representing an 
optical image having a substantially flat brightness . 

Where the method is an analog process, the step of adding 
includes a compensating signal generating device which is an 
analog signal generating device for generating the compensating 
signal. Similarly, where the method is a digital process, the 
step of adding includes a compensating signal generating device 
which is an digital signal processing device for generating the 
compensating signal * 

If it is desired to raise the brightness level of the 
compensated video signal, the method further includes the step 
of : (a) increasing with a control device operatively coupled to 
the adder the brightness of the output video signal to a level 
which is greater than the average of the differential brightness 
of the optical image due to the uneven illumination. For 
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impedance matching, the method further includes the step of: (a) 
applying, with a driver amplifier operatively coupled to the 
adder, the output video signal to a video signal processor at a 
low impedance . 

In the preferred embodiment, the method includes the use of 
a compensating signal generating device which is an analog signal 
generating device for generating the compensating signal • The 
method further comprises the steps of: (a) generating with a 
sawtooth wave generator a sawtooth waveform having a 
predetermined rising slope, a predetermined falling slope and a 
controlled amplitude, (b) generating with a parabola wave 
generator a parabola waveform having a controlled amplitude and 
orientation; and (c) adding with an analog signal adder the 
sawtooth waveform, the parabolic waveform and the video signal to 
produce the compensating signal* 

Although the preferred embodiment of the present invention 
is used in a medical laparoscope having a fiber optic light 
guide, the video signal compensator can be used with any optical 
system where a light source having a non -uniform or uneven 
characteristics is used to illuminate an operative site or 
inspection area providing an optical image having differentiated 
picture brightness due to the uneven illumination. The light 
source may be located intermediate the endoscope or at the distal 
end of the endoscope * 
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It is also envisioned that the teachings of the p:tresent 
invention can be used foir industrial applications. For example, 
borescopes are used to inside the inspect the interior stages of 
jet engines. Typically, the optical image produced by a 
borescope is imaged directly on a video camera. The video signal 
compensator disclosed and taught herein can be used for such 
industrial applications. Further, person skilled on the art can 
identify other applications where the uneven brightness of an 
optical image can be compensated to produce a substantially 
uniform brightness level. It is envisioned that this invention 
can be used for such applications. 

255 7256spec 
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WHAT IS CI.AIMED IS: 

1. An apparatus for compensating differential picture 
brightness of an optical image due to uneven illumination from an 
endoscope imaged onto a video camera comprising 

a device for generating a compensating signal substantially- 
representing at least one parameter of a compensating waveform 
required for the differential picture brightness of an optical 
Q image to produce a video signal representing an optical image 

W having a substantially uniform brightness; and 

IXI 

a logic device operatively coupled to said compensating 
^ signal generating device and a video signal for adding the 
O compensating signal and the video signal to produce an output 
ry video signal having its gain both vertically and horizontally 
%0 compensated to represent an image having a substantially uniform 
brightness . 

2 . The apparatus of Claim 1 wherein said compensating 
signal device further includes 

a device for generating a sawtooth waveform having a 
predetermined rising slope ^ a predetermined falling slope and a 
controlled amplitude; and 

a device for generating a parabola waveform having a 
controlled amplitude and orientation. 

3 . The apparatus of Claim 2 wherein said logic device 
further includes 
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an adder operatively coupled to and adding said sawtooth 
waveform device, said parabolic waveform device and a video 
signal to produce a compensating signal which is applied to an 
adder together with a video signal used as an input to a video 
signal processor adjusting its gain both vertically and 
horizontally by increasing the gain of the video signal 
representing that part of the optical image which is less bright 
relative to a reference and reducing the gain of the video signal 
representing that part of the optical image which is brighter 
than a reference and wherein said video signal representing an 
optical image having a substantially uniform brightness, 

4 . A video signal compensator for compensating 
differential picture brightness of an optical image due to uneven 
illumination comprising 

a device for generating a compensating signal substantially 
representing at least one parameter of a compensating waveform 
required for the differential picture brightness of an optical 
image to produce a video signal representing an optical image 
having a substantially uniform brightness; and 

an adder operatively coupled to said compensating signal 
generating device and a video signal for adding the compensating 
signal and the video signal to produce an output video signal 
having its gain both vertically and horizontally compensated by 
increasing the gain of the video signal representing that part of 
the optical image which is less bright than a reference and 
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ireducing the gain of the video signal representing that part of 
the optical image which is brighter than a reference compensating 
said video signal to represent an image having a substantially 
uniform brightness . 

5. The video compensator of claim 4 wherein said 
differential picture brightness of an optical image is brighter 
at its center than at its periphery and wherein said adder adds 
said sawtooth waveform, said parabolic waveform and said video 
signal to produce a compensating signal as an input to a video 
signal processor to adjust its gain both vertically and 
horizontally by increasing the gain of the video signal in 
response the sawtooth waveform representing the periphery of the 
optical image and reducing the gain of the video signal in 
response to the parabolic waveform representing the center of the 
optical image resulting in said video signal representing an 
optical image having a substantially flat brightness. 

6 . The video compensator of claim 4 wherein said 
differential picture brightness of an optical image is brighter 
at its periphery than at its center and wherein said adder adds 
said sawtooth waveform, said parabolic waveform and said video 
signal to produce a compensating signal as an input to a video 
signal processor to adjust its gain both vertically and 
horizontally by decreasing the gain of the video signal in 
response the sawtooth waveform representing the periphery of the 
optical image and increasing the gain of the video signal in 



255 012797 7256 613100/1580 

^response to the pa-irabolic waveform representing th.e center of the 
optical image resulting in said video signal representing an 
optical image having a substantially flat brightness. 

7. The video signal compensator of claim 4 wherein said 
compensating signal generating device is an analog signal 
generating device. 

8 . The video signal compensator of claim 4 wherein said 
compensating signal generating device is an digital signal 
generating device. 

9 . The video signal compensator of claim 7 wherein said 
analog signal generating device comprises 

a sawtooth wave generator for generating a sawtooth waveform 
having a predetermined rising slope, a predetermined falling 
slope and controlled amplitude; 

a parabola wave generator for generating a parabola waveform 
having a controlled amplitude and orientation; and 

an analog signal adder operatively coupled to said sawtooth 
wave generator and said parabolic wave generator to add the 
sawtooth waveform and the parabolic waveform to produce a 
compensating signal . 

10 . The video signal compensator of claim 9 further 
comprising 

a control device operatively coupled to said adder to 
increase the brightness of the compensating signal to a level 
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which is greater than the average of the differential brightness 
of the optical image due to the uneven illumination. 

11. The video signal compensator of claim 8 wherein said 
digital signal generating device produces an analog compensating 
signal including illumination and color signals and wherein said 
digital signal generating device further includes 

a digital storage device for receiving and storing a digital 
representation of the video signal having the differential 
brightness due to uneven illumination; and 

a digital-to-analog converter operatively coupled to said 
digital storage device for producing an analog video signal 
representing the differential picture brightness of the optical 
image due to uneven illumination and applying the video signal to 
a first and second adder together with the analog compensating 
signal, wherein said first adder and second adder produce as an 
output compensated analog video signal which is applied to an 
analog video signal processor to produce a video signal having 
its gain both vertically and horizontally compensated by 
decreasing the gain of the video signal in response the sawtooth 
waveform representing the periphery of the optical image and 
increasing the gain of the video signal in response to the 
parabolic waveform representing the center of the optical image 
resulting in said video signal representing an optical image 
having a substantially flat brightness. 
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12. The video signal compensator of claim 8 wherein said 
digital signal generating device includes 

a digital storage device for storing a digital 
representation of the video signal having the differential 
brightness due to uneven illumination; and 

a programmable digital processor for digitally processing a 
digital representation of the video signal representing the 
differential picture brightness of the optical image due to 
uneven illumination to produce a digital compensating signal 
representing at least one parameter of a compensating waveform 
ireguired to produce a video signal representing an optical image 
having a substantially uniform brightness and applying the 
digital compensating signal to said adder. 

13 . The video signal compensator of claim 12 wherein said 
programmable digital processor includes a pixel 
multiplexer/processor . 

14 . The video signal compensator of claim 8 wherein said 
digital signal generating device includes 

a digital storage device for storing, for a predetermined 
period of time, a digital representation of the video signal 
having the differential brightness due to uneven illumination and 
applying said stored distal signal to an adder of adding the 
stored video signal with luminance and color compensating signal. 

15 . The video signal compensator of claim 8 wherein said 
digital signal generating device includes 
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a digital storage device for storing, for a predetermined 
time period, a digital representation of the video signal having 
the differential brightness due to uneven illumination and 
applying said stored digital signal to said pixel 
multiplexer/processor . 

16. An apparatus for compensating differential picture 
brightness of an optical image due to uneven illumination from an 
endoscope imaged onto a video camera comprising 

a device for generating a sawtooth waveform having a 
predetermined rising slope, a predetermined falling slope and a 
controlled amplitude ; 

a device for generating a parabola waveform having a 
controlled amplitude and orientation; and 

a logic device operatively coupled to and adding said 
sawtooth waveform device, said parabolic waveform device and a 
video signal to produce a compensating signal which is applied to 
an adder together with a video signal used as an input to a video 
signal processor adjusting its gain both vertically and 
horizontally by increasing the gain of the video signal 
representing that part of the optical image which is less bright 
relative to a reference and reducing the gain of the video signal 
representing that part of the optical image which is brighter 
than a reference and wherein said video signal representing an 
optical image having a substantially uniform brightness. 
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17. The apparatus of claim 16 further comprising 

a control device operatively coupled to said logic device to 
increase the brightness of the compensating signal to a level 
which is greater than the average of the differential brightness 
of the optical image due to the uneven illumination. 

18 . The Apparatus of claim 16 further including 

a video driver amplifier operatively coupled to said logic 
device to apply the compensating signal to the video signal 
processor at a low impedance. 

19 . An apparatus for compensating for differential picture 
brightness of an optical image due to uneven illumination 
comprising 

means for generating a sawtooth waveform having a 
predetermined rising slope ^ a predetermined falling slope and a 
controlled amplitude ; 

means for generating a parabola waveform having a controlled 
amplitude ; and 

an adder means operatively coupled to said sawtooth waveform 
device, said parabolic waveform device and a video signal for 
adding the sawtooth waveform, the parabolic waveform and the 
video signal to produce a compensating video signal used as an 
input to a video signal processor adjusting its gain both 
vertically and horizontally increasing the gain of the video 
signal representing that part of the optical image which is less 
bright than a reference and reducing the gain of the video signal 
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representing that part of tlie optical image whiicla is brighter 
than a reference compensating said video signal to represent an 
optical image having substantially uniform brightness. 

20. A video signal compensator for compensating for 
differential picture brightness of an optical image due to uneven 
illumination from an endoscope imaged onto a video sensor 
comprising 

means for generating a compensating signal substantially 
representing at least one parameter of a compensating waveform 
required for the differential picture brightness of an optical 
image from the endoscope to produce a video signal representing 
an optical image having a substantially uniform brightness; and 

adding means operatively coupled to said compensating signal 
generating means and a video signal for adding the compensating 
signal and the video signal to produce a compensating video 
signal which is applied to an input to video signal processor 
having its gain both vertically and horizontally compensated by 
increasing the gain of the video signal representing that part of 
the optical image from an endoscope which is less bright than a 
reference and reducing the gain of the video signal representing 
that part of the optical image from the endoscope which is 
brighter than a reference compensating said video signal to 
represent an optical image having a substantially uniform 
brightness . 
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21. The video signal compensator- of claim 20 wbexein said 
compensating signal geneirating means further comprising 

a sawtooth wave generator for generating a sawtooth waveform 
having a predetermined rising slope, a predetermined falling 
slope and controlled amplitude; 

a parabola wave generator for generating a parabola waveform 
having a controlled amplitude and orientation; and 

an analog signal adder operatively coupled to said sawtooth 
wave generator and said parabolic wave generator to add the 
sawtooth waveform and the parabolic waveform to produce a 
compensating signal . 

^ 21. The video signal compensator of claim 20 further 
comprising 

a control device operatively coupled to said adding means to 
increase the brightness of the output video signal to a level 
which is greater than the average of the differential brightness 
of the optical image due to the uneven illumination. 

^-^'"^ 22 . A device for compensating for differential picture 
brightness of an optical image brighter at its center than at its 
edges imaged onto a video camera comprising 

a sawtooth wave generator for generating a sawtooth waveform 
having a predetermined rising slope, a predetermined falling 
slope and a controlled amplitude; 

a parabola wave generator for generating a parabola waveform 
having a controlled amplitude and orientation; 
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an adder- opeiratively coupled to said sawtooth wave 
generator, said parabolic wave generator and a video signal for 
adding said sawtooth waveform, said parabolic waveform and said 
video signal to produce a compensating video signal used as an 
input to a video signal processor for adjusting its gain both 
vertically and horizontally compensated by increasing the gain of 
the video signal in response the sawtooth waveform representing 
the periphery of the optical image and reducing the gain of the 

-=S video signal in response to the parabolic waveform representing 

the center of the optical image compensating said video signal to 

m represent an optical image having a substantially flat 

s brightness . 

W 23 . A system comprising 

an endoscope having a proximal end and a distal end; 

"■^ a light guide located within the endoscope and extending 

from the proximal end to the distal end of the endoscope, said 
light guide having a light post at its proximal end which is 
adapted to receive light energy from a light source to transmit 
the light energy from its distal end to illuminate an operative 
s i t e ; 

an optical image transferring member located with the 
endoscope and extending from the proximal end to the distal end 
of the endoscope; 

a light source operatively connected to the light post to 
apply light energy to the light guide ; 
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a video sensor- openratively coupled to the distal end of the 
endoscope foir imaging an optical image having dif f e^rent ial 
pictuire birightness due to uneven illumination; 

compensating apparatus ope^ratively coupled to said video 
sensor comprising 

a sawtooth wave generator for generating a sawtooth 
waveform having a predetermined rising slope, a predetermined 
falling slope and a controlled amplitude; 

a parabola wave generator for generating a parabola 
waveform having a controlled amplitude and orientation; and 

an adder operatively coupled to said sawtooth wave 
generator, said parabolic wave generator and a video signal for 
adding said sawtooth waveform, said parabolic waveform and said 
video signal to produce a compensating video signal used as an 
input to video signal processor adjusting its gain both 
vertically and horizontally compensated by increasing the gain of 
the video signal representing that part of the optical image 
which is less bright than a reference and reducing the gain of 
the video signal representing that part of the optical image 
which is brighter than a reference compensating said video signal 
to represent an image having a substantially uniform brightness. 

2^ . The system of claim 23 wherein said light guide is a 
fiber optic light guide and the differential picture brightness 
is brighter at its center than at its edges and wherein said 
compensating apparatus produces a compensating video signal used 
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as a.n input to a video signal processonr adjusting its gain iDoth. 
veortically and horizontally compensated by increasing the gain of 
the video signal in response the sawtooth waveform representing 
the periphery of the optical image and reducing the gain of the 
video signal in response to the parabolic waveform representing 
the center of the optical image compensating said video signal to 
represent an optical image having a substantially flat 
brightness . 

The system of claim 23 further comprising 
an amplifier for amplifying the compensated video signal; 

and 

a sensing device operatively coupled to the amplifier for 
receiving the compensated video signal and for sensing and 
removing noise therefrom. 

^ . A method for compensating for differential picture 
brightness of an optical image due to uneven illumination 
comprising the steps of 

generating with a compensating signal device a compensating 
signal substantially representing at least one parameter of a 
compensating waveform required for the differential picture 
brightness of an optical image to produce a video signal 
representing an optical image having a substantially uniform 
brightness; and 

adding with an adder operatively coupled to said 
compensating signal generating device and a video signal the 
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compensating- signal and the video signal to pr-oduce an output 
compensating video signal having its gain both veirtically and 
hoirizontally compensated by incoreasing the gain of the video 
signal r-epiresent ing that pa^rt of the optical image which is less 
br-ight than a irefeirence and reducing the gain of the video signal 
r-ep^resenting that part of the optical image which is brighter 
than a reference compensating said video signal to represent an 
optical image having a substantially uniform brightness. 

2/1 , The method of claim 26 wherein said differential 
picture brightness of an optical image is brighter at its center 
than at its edges and wherein the step of adding produces a 
compensating signal used as an input to a video signal processor 
adjusting its gain both vertically and horizontally compensated 
by increasing the gain of the video signal in response the 
sawtooth waveform representing the edges of the optical image and 
reducing the gain of the video signal in response to the 
parabolic waveform representing the center of the optical image 
compensating said video signal to represent an optical image 
having a substantially flat brightness . 

/l^ , The method of claim 26 wherein said differential 
picture brightness of an optical image is brighter at its edges 
than at its center and wherein the step of adding 

produces a compensating signal used as an input to a video signal 
processor adjusting its gain both vertically and horizontally by 
decreasing the gain of the video signal in response the sawtooth 
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waveform representing the edges of the optical image and 
increasing the gain of the video sdgnal in response to the 
parabolic waveform representing the edges of the optical image 
resulting in said video signal representing an optical image 
having a substantially flat brightness. 

The method of claim 26 wherein the step of adding 
includes a compensating signal generating device which is an 
analog signal generating device for generating the compensating 
signal . 

3^. The method of claim 26 wherein the step of adding 
includes a compensating signal generating device which is an 
digital signal generating device for generating the compensating 
signal . 

3^. The method of claim 26 further including the step of 
increasing with a control device operatively coupled to said 

adder the brightness of the output video signal to a level which 

is greater than the average of the differential brightness of the 

optical image due to the uneven illumination. 

3^ . The method of claim 26 further including the step of 
applying with a video driver amplifier operatively coupled 

to said adder the output video signal to a video camera through a 

low impedance . 
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The method of claim 29 wheirein said step of adding 
which includes a compensating signal gene^rating device which is 
an analog signal generating device for generating the 
compensating signal further comprises the steps of 

generating with a sawtooth wave generator a sawtooth 
waveform having a predetermined rising slope, a predetermined 
falling slope and a controlled amplitude; 

generating with a parabola wave generator a parabola 
waveform having a controlled amplitude and orientation; and 

adding with an analog signal adder the sawtooth waveform, 
the parabolic waveform and the video signal to produce a 
compensating signal . 

255 7256clai 
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Name 



Registration 
Number 



Michael E. Schmitt 
Bradley M. Ganz 



36,921 
34,170 



Zl Additional registered practitionerfs) named on supplemental Registered Practitioner Infonnation sheet PTO/SB/02C attached hereto. 



Direct all correspondence to: □ Customer Number 

or Bar Code Label 



OR H Correspondence address below 



Name 



Michael E. Schmitt 



Address 



P.O. Box 10105 



Address 



City 



Portland 



state OR 



ZIP 



97?9ft 



Country 



USA 



Telephone 



503.297.8699 



Fax 



508.355.6127 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and belief are 
believed to be true; and further that these statements were made with the knowledge that willful false statements and the like so made are 
punishable by fine or imprisonment, or both, under 18 U.S.C. 1001 and that such willful false statements may jeopardize the validity of the 
application or any patent issued thereon. 



Name of Sole or First Inventor; 



n A petition has been filed for this unsigned inventor 



Given Nanr^e (first and middle Hf anvl) 



Family Namp nr RtirnamR 



Frederick A> 



Miller 



Inventor's 
Signature 



Residence: City 



Post Office Address 



Santa Barbara state 



Country 



USA 



Date 



Citizenship 



USA 



5087A Rhodes Ave, 



Post Office Address 



City 



Santa Barbarci state CA 



ZIP 



93111 



Country 



Cl&dditional inventors are being named on the supplemental Additional Inventor(s) sheet(s) PTO/SB/02A attached hereto 
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Please type a plus sign (+) inside this box -> 



PTO/SB/02A {3-97} 
Approved for use through 9/30/98. 0MB 0651 -0032 
Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE 
Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a 
valid 0MB control number. 



DECLARATION 



ADDITIONAL INVENTOR{S) 
Supplemental ^|eet 



Name of Additional Joint Inventor, if any: 



n A petition has been filed for tliis unsigned inventor 



Given Name (first and middle [if any]) 



Family Name or Surname 



Abraham 



Kotlyar 



Inventor's 
Signature 



Date 



Residence: City 



Goleta 



state 



CA 



Country 



USA 



Citizenship 



USA 



Post Office Address 



158 Verona Ave. 



Post Office Address 



City 



Goleta 



state 



CA 



ZIP 



93117 



Country [JSA 



Name of Additional Joint Inventor, if any: 



n A petition lias been filed for this unsigned inventor 



Given Name (first and middle [if any]) 



Family Name or Surname 



Frank D, 



D' Amelio 



Inventor's 
Signature 



Date 



Residence: City 



Los Olivos 



state 



CA 



Country 



USA 



Citizenship 



USA 



Post Office Address 



2813 Gaviota St,: PQB 354 



Post Office Address 



City 



Los Olivos 



state 



Name of Additional Joint Inventor, if any: 



CA 



ZIP 



93442 



Country 



USA 



n A petition has been filed for this unsigned inventor 



Given Name {first and middle [if any]) 



Erhan 



Family Name or Surname 



Gunday 



Inventor's 
Signature 



Residence: City 



Santa Barbara state CA 



Country 



USA 



Date 



Citizenship 



urkey 



Post Office Address 



2938 Holly Road 



Post Office Address 



City 



Sar 



ta Barbara 



state 



CA 



ZIP 



93105 



Country 



USA 



+ 



Burden Hour Statement: Thfs form is estimated to take 0.4 hours to complete. Time will vary depending upon the needs of the individual case. Any 
comments on the af^o""* of time pu are required to complete this form should be sent to the Chief Information Officer. Patent and Trademari< 
pSs wfstt^^ ^^^^ COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for 



Please type a plus sign (+) inside this box -» [ -f [ 



PTO/SB/02A (3-97) 
Approved for use tlirough 9/30/98 OMB 0651 -0032 
lin^^rth^D-, r A * ..no. Patent BHd Trademark Offfcs; U.S. DEPARTMENT OF COMMERCE 

under the PapenA/ork Reduction Act of 1995, no persons are required to respond to a collection of information unless It contains a 
valid OMB control number. 





DECLARATION 


ADDITIONAL INVENTOR(S) 
Supplemental Sheet 








Page of 





Name of Additional Joint Inventor, if any: 



n A petition has been filed for this unsigned inventor 



Given Name (first and middle [if any]) 



Family Name or Surname 



Inventor's 
Signature 




Date 




Residence: City 


Ventura 


state 


CA 


Country 


USA 


Citizenship 


TISfl 



Post Office Address 



2337 Pima Lane 



Post Office Address 



City 



Ventura 



state CA 



2'P I 93001 I Country I nSA 



Name of Additional Joint inventor, if any: 



n A petition has been filed for this unsigned inventor 



Given Name (first and middle [if any]) 



Family Name or Surname 



Inventor's 
Signature 




Date 




Residence: City 




State 


Country 




Citizenship 




Post Office Address 








Post Office Address 




City 




State 


ZIP 


Country 



Name of Additional Joint inventor, if any; 



I I A petition has been filed for this unsigned inventor 



Given Name (first and middle [if any]) 



Family Name or Surname 



Inventor's 
Signature 




Date 




Residence: City 




State 




Country 




Citizenship 





Post Office Address 



Post Office Address 



City 



State 




ZIP 




Country 



+ 



X;n..^^r^to '^^^ Mii^ .vj.M. «buindiea lo taKe u.^ nours to complete. Time will vary depending upon the needs of the individual case. Any 
S^r^wLh^nnt^n^T^^^n?^^^ ^^'^ ^^^"^ ^^"^ the Chief Iriformatioh Officer, Patent and Trademark 

Ss wlshi^^^^^^^^ ^° ^^^^ ^^^^ COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for 



